thelondoneconomic.com
robots.txt

Robots Exclusion Standard data for thelondoneconomic.com

Resource Scan

Scan Details

Site Domain thelondoneconomic.com
Base Domain thelondoneconomic.com
Scan Status Ok
Last Scan2024-06-29T07:06:24+00:00
Next Scan 2024-07-06T07:06:24+00:00

Last Scan

Scanned2024-06-29T07:06:24+00:00
URL https://thelondoneconomic.com/robots.txt
Redirect https://www.thelondoneconomic.com/robots.txt
Redirect Domain www.thelondoneconomic.com
Redirect Base thelondoneconomic.com
Domain IPs 104.26.8.123, 104.26.9.123, 172.67.75.33, 2606:4700:20::681a:87b, 2606:4700:20::681a:97b, 2606:4700:20::ac43:4b21
Redirect IPs 104.26.8.123, 104.26.9.123, 172.67.75.33, 2606:4700:20::681a:87b, 2606:4700:20::681a:97b, 2606:4700:20::ac43:4b21
Response IP 104.26.8.123
Found Yes
Hash e1feb2a22fee00bd168915f9e3c5c529af10937104df8073641f95b8ff6940b4
SimHash 4a00dec2aab2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thelondoneconomic.com/sitemap_index.xml
sitemap https://www.thelondoneconomic.com/news-sitemap.xml