galleryvault.xyz
robots.txt

Robots Exclusion Standard data for galleryvault.xyz

Resource Scan

Scan Details

Site Domain galleryvault.xyz
Base Domain galleryvault.xyz
Scan Status Ok
Last Scan2024-05-13T07:18:35+00:00
Next Scan 2024-05-20T07:18:35+00:00

Last Scan

Scanned2024-05-13T07:18:35+00:00
URL http://galleryvault.xyz/robots.txt
Redirect http://www.galleryvault.xyz/robots.txt
Redirect Domain www.galleryvault.xyz
Redirect Base galleryvault.xyz
Domain IPs 199.34.228.77
Redirect IPs 199.34.228.77
Response IP 199.34.228.77
Found Yes
Hash 3809274a69c8f545badeb7e9bcbf519a35e98a07f456c30985e41ebd7d8953c1
SimHash 2354dc542793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.galleryvault.xyz/sitemap.xml