wad-archive.com
robots.txt

Robots Exclusion Standard data for wad-archive.com

Resource Scan

Scan Details

Site Domain wad-archive.com
Base Domain wad-archive.com
Scan Status Ok
Last Scan2025-11-11T18:42:49+00:00
Next Scan 2025-11-18T18:42:49+00:00

Last Scan

Scanned2025-11-11T18:42:49+00:00
URL https://wad-archive.com/robots.txt
Redirect https://www.wad-archive.com/robots.txt
Redirect Domain www.wad-archive.com
Redirect Base wad-archive.com
Domain IPs 104.21.1.10, 172.67.151.186, 2606:4700:3030::ac43:97ba, 2606:4700:3033::6815:10a
Redirect IPs 104.21.1.10, 172.67.151.186, 2606:4700:3030::ac43:97ba, 2606:4700:3033::6815:10a
Response IP 172.67.151.186
Found Yes
Hash b94b6b0d98ac00fa21e47e8a011c6771e507e1954a0428a0ac292db7bf783b76
SimHash 485c9d486e82

Groups

*

Rule Path
Disallow /search
Disallow /wad/lumps/

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wad-archive.com/sitemap.xml
sitemap https://www.wad-archive.com/wadlist.txt.gz
sitemap https://www.wad-archive.com/wadlist2.txt.gz