citytrend.com.ng
robots.txt

Robots Exclusion Standard data for citytrend.com.ng

Resource Scan

Scan Details

Site Domain citytrend.com.ng
Base Domain citytrend.com.ng
Scan Status Ok
Last Scan2024-09-01T19:52:30+00:00
Next Scan 2024-10-01T19:52:30+00:00

Last Scan

Scanned2024-09-01T19:52:30+00:00
URL https://citytrend.com.ng/robots.txt
Redirect https://web.citytrend.com.ng/robots.txt
Redirect Domain web.citytrend.com.ng
Redirect Base citytrend.com.ng
Domain IPs 104.21.46.203, 172.67.141.175, 2606:4700:3031::6815:2ecb, 2606:4700:3035::ac43:8daf
Redirect IPs 104.21.46.203, 172.67.141.175, 2606:4700:3031::6815:2ecb, 2606:4700:3035::ac43:8daf
Response IP 172.67.141.175
Found Yes
Hash fdb829215763ec822908a0de5641673de7a6a343a339d80ef8c6f1cea8dc927c
SimHash 6109c8c1cf95

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://web.citytrend.com.ng/sitemap.xml