profitunder30.mystagingwebsite.com
robots.txt

Robots Exclusion Standard data for profitunder30.mystagingwebsite.com

Resource Scan

Scan Details

Site Domain profitunder30.mystagingwebsite.com
Base Domain mystagingwebsite.com
Scan Status Ok
Last Scan2025-03-29T17:22:41+00:00
Next Scan 2025-04-28T17:22:41+00:00

Last Scan

Scanned2025-03-29T17:22:41+00:00
URL https://profitunder30.mystagingwebsite.com/robots.txt
Redirect https://profithoot.com/robots.txt
Redirect Domain profithoot.com
Redirect Base profithoot.com
Domain IPs 199.16.172.100, 199.16.173.200
Redirect IPs 199.16.172.76, 199.16.173.167
Response IP 199.16.172.76
Found Yes
Hash 1bf7bc1e5b35e8f178e17528a189a5cac57cecde841edad0985eb4bf0b38e7f4
SimHash 6d1508505713

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://profithoot.com/sitemap.xml
sitemap https://profithoot.com/news-sitemap.xml
sitemap https://profithoot.com/sitemap_index.xml