tfgm.com
robots.txt
Robots Exclusion Standard data for tfgm.com
Resource Scan
Scan Details
| Site Domain | tfgm.com |
| Base Domain | tfgm.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-27T10:05:40+00:00 |
| Next Scan | 2024-12-26T10:05:40+00:00 |
Last Successful Scan
| Scanned | 2024-05-24T09:57:41+00:00 |
| URL | https://tfgm.com/robots.txt |
| Domain IPs | 108.157.254.104, 108.157.254.12, 108.157.254.28, 108.157.254.30 |
| Response IP | 108.157.254.28 |
| Found | Yes |
| Hash | 620710393bfb4e55781bbe6e27e86f3cd89fbc0a63d0d5cb261a94ed386b5e8a |
| SimHash | e9045815dfd0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?*tab=* |
| Disallow | /*?*cookies=true |
| Disallow | /*?*line=* |
| Disallow | /*?*_=* |
| Disallow | /*?*q=* |
| Disallow | /public-transport/bus/stops/*/* |
| Disallow | /public-transport/bus/stations/*/* |
| Disallow | /tickets-and-passes/results* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tfgm.com/sitemap.xml |