dramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world · 11 months agoChad scrapersh.itjust.worksimagemessage-square91fedilinkarrow-up11.03Karrow-down128
arrow-up11Karrow-down1imageChad scrapersh.itjust.worksdramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world · 11 months agomessage-square91fedilink
minus-squareDAMunzy@lemmy.dbzer0.comlinkfedilinkarrow-up17·11 months agoBut, but, norobots.txt! Chad doesn’t care!
minus-squarePoolloverNathan@programming.devlinkfedilinkEnglisharrow-up6·11 months agouses curl manually instead
But, but, norobots.txt!
Chad doesn’t care!
uses curl manually instead