Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · 8 days agoMillions of websites to get 'game-changing' AI bot blockerwww.bbc.comexternal-linkmessage-square24fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkMillions of websites to get 'game-changing' AI bot blockerwww.bbc.comDavriellelouna@lemmy.world to Technology@lemmy.worldEnglish · 8 days agomessage-square24fedilink
minus-squareauraithx@piefed.sociallinkfedilinkEnglisharrow-up0·8 days agoYeah this will have absolutely no impact to gathering training data. I assumed it was to block ai agents crawling it during requests, which they’d be unlikely to bypass in the web ui. But no company spending millions on training will hesitate to have an agent appear as a regular desktop user to scrape data.
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up0·8 days agoDoes cloudflare still look at the agent? I thought they have more reliable data points.
minus-squareauraithx@piefed.sociallinkfedilinkEnglisharrow-up0·8 days agoI meant an ai agent not the browser agent. All data points can be spoofed and if not they’ll pay a human to scrape before they pay for content.
Yeah this will have absolutely no impact to gathering training data.
I assumed it was to block ai agents crawling it during requests, which they’d be unlikely to bypass in the web ui.
But no company spending millions on training will hesitate to have an agent appear as a regular desktop user to scrape data.
Does cloudflare still look at the agent? I thought they have more reliable data points.
I meant an ai agent not the browser agent. All data points can be spoofed and if not they’ll pay a human to scrape before they pay for content.