Log In Sign Up

trueactivist.com
robots.txt

Robots Exclusion Standard data for trueactivist.com

Resource Scan

Scan Details

Site Domain trueactivist.com
Base Domain trueactivist.com
Scan Status Ok
Last Scan2024-11-11T06:53:46+00:00
Next Scan 2024-11-18T06:53:46+00:00

Last Scan

Scanned2024-11-11T06:53:46+00:00
URL https://trueactivist.com/robots.txt
Domain IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.137.54
Found Yes
Hash 9b18f1ed054aa2124f1f705f769e450ce4806b0b6a5e11d84038bb22bafc1fd9
SimHash e7adde50a9b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-admin/admin-ajax.php

mozilla/5.0 (compatible; grapeshotcrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)

Rule Path
Disallow /husband-discovers-wifes-secret-identity-in-a-locked-box-years-after-she-dies-gallery-t2/*/?
Disallow /celebrities-who-started-off-as-porn-stars-t2/*/?

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://trueactivist.com/sitemap_index.xml
Back to top