transportnews.eu
robots.txt

Robots Exclusion Standard data for transportnews.eu

Resource Scan

Scan Details

Site Domain transportnews.eu
Base Domain transportnews.eu
Scan Status Ok
Last Scan2024-11-13T21:00:31+00:00
Next Scan 2024-11-20T21:00:31+00:00

Last Scan

Scanned2024-11-13T21:00:31+00:00
URL https://transportnews.eu/robots.txt
Domain IPs 91.237.52.145
Response IP 91.237.52.145
Found Yes
Hash f14c7aed1e7463beb7e8c41df85cdd5065ab1c00978397912aeb4daba5e1b3a8
SimHash 89259e120612

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content
Disallow /tag
Disallow /author
Disallow /wget/
Disallow /httpd/
Disallow /i/
Disallow /f/
Disallow /t/
Disallow /c/
Disallow /j/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver-web.archive.org

Rule Path
Allow /

Other Records

Field Value
sitemap http://transportnews.eu/sitemap.xml