Cynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 1 year agoHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizexternal-linkmessage-square62linkfedilinkarrow-up1111arrow-down133
arrow-up178arrow-down1external-linkHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizCynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 1 year agomessage-square62linkfedilink
minus-squarespookedintownsville@lemmy.worldlinkfedilinkEnglisharrow-up2·1 year agoHow did you do it? Looking to do this on my own site.
minus-squareOha@lemmy.ohaa.xyzlinkfedilinkEnglisharrow-up3·1 year agoMy websites Backend is written in flask so it was pretty easy to add
How did you do it? Looking to do this on my own site.
My websites Backend is written in flask so it was pretty easy to add