Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 9 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square180fedilinkarrow-up1592arrow-down17cross-posted to: technology@midwest.socialtechnology@beehaw.orgtechnology@lemmy.zip
arrow-up1585arrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 9 months agomessage-square180fedilinkcross-posted to: technology@midwest.socialtechnology@beehaw.orgtechnology@lemmy.zip
minus-squarericecake@sh.itjust.workslinkfedilinkEnglisharrow-up9·9 months agoPeople not intending to follow it is the real reason not to bother, but it’s trivial to track who downloaded the file and then hit something they were asked not to. Like, 10 minutes work to do right. You don’t need js to do it at all.
People not intending to follow it is the real reason not to bother, but it’s trivial to track who downloaded the file and then hit something they were asked not to.
Like, 10 minutes work to do right. You don’t need js to do it at all.