tfgm.com
robots.txt

Robots Exclusion Standard data for tfgm.com

Resource Scan

Scan Details

Site Domain tfgm.com
Base Domain tfgm.com
Scan Status Ok
Last Scan2024-05-10T09:47:09+00:00
Next Scan 2024-05-24T09:47:09+00:00

Last Scan

Scanned2024-05-10T09:47:09+00:00
URL https://tfgm.com/robots.txt
Domain IPs 108.157.254.104, 108.157.254.12, 108.157.254.28, 108.157.254.30
Response IP 108.157.254.12
Found Yes
Hash 620710393bfb4e55781bbe6e27e86f3cd89fbc0a63d0d5cb261a94ed386b5e8a
SimHash e9045815dfd0

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /*?*tab=*
Disallow /*?*cookies=true
Disallow /*?*line=*
Disallow /*?*_=*
Disallow /*?*q=*
Disallow /public-transport/bus/stops/*/*
Disallow /public-transport/bus/stations/*/*
Disallow /tickets-and-passes/results*

Other Records

Field Value
sitemap https://tfgm.com/sitemap.xml