urlit.me
robots.txt

Robots Exclusion Standard data for urlit.me

Resource Scan

Scan Details

Site Domain urlit.me
Base Domain urlit.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-21T17:15:14+00:00
Next Scan 2025-11-04T17:15:14+00:00

Last Successful Scan

Scanned2025-10-06T14:08:14+00:00
URL https://urlit.me/robots.txt
Redirect https://www.chinatrade.cn.com/robots.txt
Redirect Domain www.chinatrade.cn.com
Redirect Base chinatrade.cn.com
Domain IPs 104.21.84.105, 172.67.191.95, 2606:4700:3031::6815:5469, 2606:4700:3037::ac43:bf5f
Redirect IPs 104.21.50.195, 172.67.210.8, 2606:4700:3031::ac43:d208, 2606:4700:3036::6815:32c3
Response IP 104.21.50.195
Found Yes
Hash dea5672d20086de2b822a96f4dc78fad376aeda74f4b052e04df5ff12b1d78eb
SimHash 69011c000bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.chinatrade.cn.com/sitemap_index.xml