Log In Sign Up

personal-reviews.com
robots.txt

Robots Exclusion Standard data for personal-reviews.com

Resource Scan

Scan Details

Site Domain personal-reviews.com
Base Domain personal-reviews.com
Scan Status Ok
Last Scan2024-09-15T05:33:45+00:00
Next Scan 2024-09-22T05:33:45+00:00

Last Scan

Scanned2024-09-15T05:33:45+00:00
URL https://personal-reviews.com/robots.txt
Domain IPs 104.26.4.11, 104.26.5.11, 172.67.71.219, 2606:4700:20::681a:40b, 2606:4700:20::681a:50b, 2606:4700:20::ac43:47db
Response IP 104.26.4.11
Found Yes
Hash 20f0b637dac277951c88f3fe53816d97b147812f711368f8fe7fef0c8dfc7028
SimHash 081c18d24b93

Groups

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.personal-reviews.com/updatedsitemap.xml
Back to top