abandoned-mines.org
robots.txt

Robots Exclusion Standard data for abandoned-mines.org

Resource Scan

Scan Details

Site Domain abandoned-mines.org
Base Domain abandoned-mines.org
Scan Status Ok
Last Scan2025-08-19T20:25:32+00:00
Next Scan 2025-09-18T20:25:32+00:00

Last Scan

Scanned2025-08-19T20:25:32+00:00
URL https://abandoned-mines.org/robots.txt
Domain IPs 104.21.16.178, 172.67.215.60, 2606:4700:3033::ac43:d73c, 2606:4700:3037::6815:10b2
Response IP 104.21.16.178
Found Yes
Hash 6ba9bc22d846f84d804c6797f98a6019afaa44ecf6982bef68a9c3ccb238c278
SimHash 0c04fb30ee75

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://abandoned-mines.org/sitemap.xml