theagitator.com
robots.txt

Robots Exclusion Standard data for theagitator.com

Resource Scan

Scan Details

Site Domain theagitator.com
Base Domain theagitator.com
Scan Status Ok
Last Scan2025-05-18T13:08:31+00:00
Next Scan 2025-06-17T13:08:31+00:00

Last Scan

Scanned2025-05-18T13:08:31+00:00
URL https://theagitator.com/robots.txt
Redirect https://www.theagitator.com/robots.txt
Redirect Domain www.theagitator.com
Redirect Base theagitator.com
Domain IPs 2a02:2350:5:10c:80e0:fc64:c1c3:edaf, 46.30.213.188
Redirect IPs 2a02:2350:5:10c:80e0:fc64:c1c3:edaf, 46.30.213.188
Response IP 46.30.213.188
Found Yes
Hash e1ff244af8abb37b1c775ee513d8812c441665a89648edfbb42e5038672ec3d0
SimHash 6101c8404f93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.theagitator.com/wp-sitemap.xml