dramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world · 3 years agoChad scrapersh.itjust.worksimagemessage-square96linkfedilinkarrow-up11.07Karrow-down129
arrow-up11.04Karrow-down1imageChad scrapersh.itjust.worksdramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world · 3 years agomessage-square96linkfedilink
minus-squarebill_1992@lemmy.worldlinkfedilinkarrow-up167arrow-down2·3 years agoEveryone loves the idea of scraping, no one likes maintaining scrapers that break once a week because the CSS or HTML changed.
minus-squareAnonymousllama@lemmy.worldlinkfedilinkarrow-up22·3 years agoThis one. One of the best motivators. Sense of satisfaction when you get it working and you feel unstoppable (until the next subtle changes happens anyway)
minus-squarecamr_on@lemmy.worldlinkfedilinkarrow-up28·3 years agoI loved scraping until my ip was blocked for botting lol. I know there’s ways around it it’s just work though
minus-squarepennomi@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up42·edit-23 months agodeleted by creator
minus-squarecamr_on@lemmy.worldlinkfedilinkarrow-up15·3 years agoThat’s a good idea right there, I like that
minus-squareferret@sh.itjust.workslinkfedilinkEnglisharrow-up5·3 years agolmao, yeah, get all the exit nodes banned from amazon.
minus-squarepennomi@lemmy.worlddeleted by creatorlinkfedilinkEnglisharrow-up12·edit-23 months agodeleted by creator
minus-squarenilloc@discuss.tchncs.delinkfedilinkEnglisharrow-up3·3 years agoQueue Office Space style error and scrape for 10 hours on each node.
minus-squareTouching_Grass@lemmy.worldlinkfedilinkarrow-up8arrow-down1·edit-23 years agoYou guys use IP’s?
minus-squaresynae[he/him]@lemmy.sdf.orglinkfedilinkEnglisharrow-up7·3 years agoToken ring for me baybeee
minus-squarecamr_on@lemmy.worldlinkfedilinkarrow-up7·3 years agoI’m coding baby’s first bot over here lol, I could probably do better
minus-squaredangblingus@lemmy.worldlinkfedilinkarrow-up11·3 years agoOr in the case of wikipedia, every table on successive pages for sequential data is formatted differently.
minus-squareMatriks404@lemmy.worldlinkfedilinkarrow-up8arrow-down1·3 years agoJust use AI to make changes ¯_(ツ)_/¯
minus-squareAnn Archy@lemmy.worldBanned from communitylinkfedilinkarrow-up10·3 years agoHere take these: \\
Everyone loves the idea of scraping, no one likes maintaining scrapers that break once a week because the CSS or HTML changed.
deleted by creator
This one. One of the best motivators. Sense of satisfaction when you get it working and you feel unstoppable (until the next subtle changes happens anyway)
I feel this
I loved scraping until my ip was blocked for botting lol. I know there’s ways around it it’s just work though
deleted by creator
That’s a good idea right there, I like that
This guy scrapes
lmao, yeah, get all the exit nodes banned from amazon.
deleted by creator
Queue Office Space style error and scrape for 10 hours on each node.
You guys use IP’s?
Token ring for me baybeee
I’m coding baby’s first bot over here lol, I could probably do better
Or in the case of wikipedia, every table on successive pages for sequential data is formatted differently.
Just use AI to make changes ¯_(ツ)_/¯
Here take these: \\
¯(ツ)/¯\\ Thanks