madforseries.it
robots.txt
Robots Exclusion Standard data for madforseries.it
Resource Scan
Scan Details
| Site Domain | madforseries.it |
| Base Domain | madforseries.it |
| Scan Status | Ok |
| Last Scan | 2024-06-30T04:38:25+00:00 |
| Next Scan | 2024-07-07T04:38:25+00:00 |
Last Scan
| Scanned | 2024-06-30T04:38:25+00:00 |
| URL | https://madforseries.it/robots.txt |
| Redirect | https://www.madforseries.it/robots.txt |
| Redirect Domain | www.madforseries.it |
| Redirect Base | madforseries.it |
| Domain IPs | 80.88.88.174 |
| Redirect IPs | 80.88.88.174 |
| Response IP | 80.88.88.174 |
| Found | Yes |
| Hash | 709ef273e868d77ce31b3fe408e06d9d6993fbb58f0867ab891bd8c2b98a8c41 |
| SimHash | 7bdcc370f2f1 |
Groups
acunetix
ahrefsbot*
awariorssbot
awariosmartbot
blexbot
bomborabot
bubing
chinaclaw
clickagy intelligence*
criteobot*
diibot
dotbot
fhscan
mauibot
megaindex.ru
mj12bot
npbot*
npbot-1/2.0
petalbot
screaming frog seo
serpstatbot
sogou spider
sogou web spider
teleport
trendictionbot
ttd-content
veooz
veoozbot
| Rule | Path |
|---|---|
| Disallow | / |
dataforseobot
proximic
shopwiki
slurp
webnews-arianna
yandex
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /serie-tv/* |
| Disallow | /uploads/2015/* |
| Disallow | /uploads/2016/* |
| Disallow | /uploads/2017/* |
| Disallow | /uploads/2018/* |
| Disallow | /uploads/2019/* |
| Disallow | /uploads/2020/* |
| Disallow | /uploads/2021/* |
| Disallow | /uploads/2022/* |
| Disallow | /uploads/2023/* |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.madforseries.it/sitemap-indice.xml |
| sitemap | https://www.madforseries.it/sitemap-google-news.xml |
Warnings
- 2 invalid lines.
Comments