websitetech.us
robots.txt

Robots Exclusion Standard data for websitetech.us

Resource Scan

Scan Details

Site Domain websitetech.us
Base Domain websitetech.us
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-14T05:21:14+00:00
Next Scan 2025-11-12T05:21:14+00:00

Last Successful Scan

Scanned2024-04-21T20:42:17+00:00
URL https://websitetech.us/robots.txt
Redirect https://www.online-listing.com/robots.txt
Redirect Domain www.online-listing.com
Redirect Base online-listing.com
Domain IPs 75.119.207.129
Redirect IPs 2607:f298:6:a014::ee1:4992, 75.119.207.129
Response IP 75.119.207.129
Found Yes
Hash a74092bdf89a8828f1897b1b54affda7d945da324e192b345dd54eaf8529dd65
SimHash 49001c404993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.online-listing.com/sitemap.xml