addall.com
robots.txt

Robots Exclusion Standard data for addall.com

Resource Scan

Scan Details

Site Domain addall.com
Base Domain addall.com
Scan Status Ok
Last Scan2024-11-13T16:55:54+00:00
Next Scan 2024-11-20T16:55:54+00:00

Last Scan

Scanned2024-11-13T16:55:54+00:00
URL https://addall.com/robots.txt
Redirect https://www.addall.com/robots.txt
Redirect Domain www.addall.com
Redirect Base addall.com
Domain IPs 67.225.152.60
Redirect IPs 67.225.152.60
Response IP 67.225.152.60
Found Yes
Hash 6ad49786ff659c1290fe6dd11116ebc8b6efe61e128e09d1eed12d4333cb56a1
SimHash 4a40d9957374

Groups

*

Rule Path
Disallow /
Disallow /blog/tags/
Disallow /SuperRare
Disallow /New
Disallow /GO/
Disallow /GO2/

googlebot

Rule Path
Disallow /*/feed/
Allow /

slurp

Rule Path
Disallow /*/feed/
Allow /

msnbot

Rule Path
Disallow /*/feed/
Allow /