agency.espreso.tv
robots.txt
Robots Exclusion Standard data for agency.espreso.tv
Resource Scan
Scan Details
Site Domain | agency.espreso.tv |
Base Domain | espreso.tv |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-15T13:09:53+00:00 |
Next Scan | 2024-07-14T13:09:53+00:00 |
Last Successful Scan
Scanned | 2023-11-25T13:08:25+00:00 |
URL | https://agency.espreso.tv/robots.txt |
Redirect | https://espreso.tv/robots.txt |
Redirect Domain | espreso.tv |
Redirect Base | espreso.tv |
Domain IPs | 104.18.10.148, 104.18.11.148, 2606:4700::6812:a94, 2606:4700::6812:b94 |
Redirect IPs | 104.18.10.148, 104.18.11.148, 2606:4700::6812:a94, 2606:4700::6812:b94 |
Response IP | 104.18.10.148 |
Found | Yes |
Hash | 72cd2dec58e6985bc0dc3b04077e37b6498d104ece40bed735b74c4fb39eaa43 |
SimHash | 28190f1241e9 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*?q= |
Disallow | /search-results* |
Disallow | /streamonline* |
Disallow | /*?* |
Disallow | /*? |
Allow | /*?page* |
Allow | /*?amp$ |
Allow | /uploads |
Allow | /uploads/photobank/ |
Allow | /uploads/*.png |
Allow | /uploads/*.jpg |
Allow | /uploads/*.jpeg |
Allow | /uploads/*.gif |
Allow | /uploads/*.svg |
Allow | /uploads/*.pdf |
Other Records
Field | Value |
---|---|
sitemap | https://espreso.tv/sitemap.xml |
Comments