astrologergauravarya.com
robots.txt

Robots Exclusion Standard data for astrologergauravarya.com

Resource Scan

Scan Details

Site Domain astrologergauravarya.com
Base Domain astrologergauravarya.com
Scan Status Ok
Last Scan2025-12-01T07:28:12+00:00
Next Scan 2025-12-08T07:28:12+00:00

Last Scan

Scanned2025-12-01T07:28:12+00:00
URL https://astrologergauravarya.com/robots.txt
Domain IPs 104.21.94.197, 172.67.168.164, 2606:4700:3030::ac43:a8a4, 2606:4700:3037::6815:5ec5
Response IP 104.21.94.197
Found Yes
Hash 8dc1f71040696928db186b1f62e24274add1e83b9baee2d3afe3bf5649c84072
SimHash 081c9c60ed91

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.astrologergauravarya.com/wp-admin/images/planche-de-jeu/sitemap.xml
sitemap https://astrologergauravarya.com/machine-%C3%A0-sous/sitemap.xml
sitemap https://www.astrologergauravarya.com/repository-data.xml