webnovelgo.com
robots.txt

Robots Exclusion Standard data for webnovelgo.com

Resource Scan

Scan Details

Site Domain webnovelgo.com
Base Domain webnovelgo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-03T13:57:16+00:00
Next Scan 2025-07-02T13:57:16+00:00

Last Successful Scan

Scanned2024-09-04T20:47:16+00:00
URL https://webnovelgo.com/robots.txt
Redirect https://ariaatr.com/robots.txt
Redirect Domain ariaatr.com
Redirect Base ariaatr.com
Domain IPs 104.21.23.113, 172.67.210.208, 2606:4700:3031::6815:1771, 2606:4700:3034::ac43:d2d0
Redirect IPs 104.21.74.110, 172.67.157.117, 2606:4700:3031::6815:4a6e, 2606:4700:3032::ac43:9d75
Response IP 172.67.157.117
Found Yes
Hash 3cd7393f3b3abae62be20da3c96b8e0062c3b242908851c3235457e012afc412
SimHash 490158004fb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://ariaatr.com/wp-sitemap.xml