webadservercdn.com
robots.txt

Robots Exclusion Standard data for webadservercdn.com

Resource Scan

Scan Details

Site Domain webadservercdn.com
Base Domain webadservercdn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-07T16:08:31+00:00
Next Scan 2025-12-06T16:08:31+00:00

Last Successful Scan

Scanned2021-09-30T23:34:16+00:00
URL https://webadservercdn.com/robots.txt
Found Yes
Hash f4d59d959645e1b933c81cb93293eda19ca3001d9620afa5e4da8059863ecdbd
SimHash 2848db80d181

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

jeeves

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$