techwebsites.net
robots.txt

Robots Exclusion Standard data for techwebsites.net

Resource Scan

Scan Details

Site Domain techwebsites.net
Base Domain techwebsites.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-30T05:39:53+00:00
Next Scan 2025-10-28T05:39:53+00:00

Last Successful Scan

Scanned2024-07-05T18:29:48+00:00
URL https://techwebsites.net/robots.txt
Domain IPs 104.21.11.146, 172.67.149.122, 2606:4700:3032::ac43:957a, 2606:4700:3034::6815:b92
Response IP 104.21.11.146
Found Yes
Hash 2529b27981664beee90b40daafe3421130ad7cfd29592486ccbd13c248e79d03
SimHash 690148000db2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://techwebsites.net/sitemap_index.xml