treasure-f.com
robots.txt

Robots Exclusion Standard data for treasure-f.com

Resource Scan

Scan Details

Site Domain treasure-f.com
Base Domain treasure-f.com
Scan Status Ok
Last Scan2024-09-20T19:30:18+00:00
Next Scan 2024-10-20T19:30:18+00:00

Last Scan

Scanned2024-09-20T19:30:18+00:00
URL https://www.treasure-f.com/robots.txt
Domain IPs 108.157.254.100, 108.157.254.126, 108.157.254.18, 108.157.254.54
Response IP 108.157.254.18
Found Yes
Hash 8f48a3970a3517fcd4f1da78db6a81a7a5aa1a700e02a6e79420fd3de598af78
SimHash 685d1dc14080

Groups

*

Rule Path
Disallow /contact/
Disallow /privacy/common_*.html$

googlebot

Rule Path
Disallow /*.pdf$

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.treasure-f.com/sitemap1.xml
sitemap https://www.treasure-f.com/sitemap2.xml
sitemap https://www.treasure-f.com/sitemap3.xml
sitemap https://www.treasure-f.com/sitemap4.xml
sitemap https://www.treasure-f.com/sitemap5.xml
sitemap https://www.treasure-f.com/sitemap6.xml
sitemap https://www.treasure-f.com/sitemap7.xml
sitemap https://www.treasure-f.com/sitemap8.xml