citytrendtv.com.ng
robots.txt

Robots Exclusion Standard data for citytrendtv.com.ng

Resource Scan

Scan Details

Site Domain citytrendtv.com.ng
Base Domain citytrendtv.com.ng
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-03T20:33:40+00:00
Next Scan 2024-10-02T20:33:40+00:00

Last Successful Scan

Scanned2024-06-05T19:16:37+00:00
URL https://citytrendtv.com.ng/robots.txt
Redirect https://web.citytrend.com.ng/robots.txt
Redirect Domain web.citytrend.com.ng
Redirect Base citytrend.com.ng
Domain IPs 104.21.74.37, 172.67.197.104, 2606:4700:3031::ac43:c568, 2606:4700:3034::6815:4a25
Redirect IPs 104.21.46.203, 172.67.141.175, 2606:4700:3031::6815:2ecb, 2606:4700:3035::ac43:8daf
Response IP 172.67.141.175
Found Yes
Hash fdb829215763ec822908a0de5641673de7a6a343a339d80ef8c6f1cea8dc927c
SimHash 6109c8c1cf95

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://web.citytrend.com.ng/sitemap.xml