comingsoon.it
robots.txt
Robots Exclusion Standard data for comingsoon.it
Resource Scan
Scan Details
| Site Domain | comingsoon.it |
| Base Domain | comingsoon.it |
| Scan Status | Ok |
| Last Scan | 2024-05-31T19:35:22+00:00 |
| Next Scan | 2024-06-07T19:35:22+00:00 |
Last Scan
| Scanned | 2024-05-31T19:35:22+00:00 |
| URL | https://comingsoon.it/robots.txt |
| Redirect | https://www.comingsoon.it/robots.txt |
| Redirect Domain | www.comingsoon.it |
| Redirect Base | comingsoon.it |
| Domain IPs | 104.22.70.145, 104.22.71.145, 172.67.23.189, 2606:4700:10::6816:4691, 2606:4700:10::6816:4791, 2606:4700:10::ac43:17bd |
| Redirect IPs | 104.22.70.145, 104.22.71.145, 172.67.23.189, 2606:4700:10::6816:4691, 2606:4700:10::6816:4791, 2606:4700:10::ac43:17bd |
| Response IP | 104.22.71.145 |
| Found | Yes |
| Hash | 3a21b3f3b95bae85a9a58af144d824dfedb91c5553b9ed6348f26f39d1ad1647 |
| SimHash | 736d5054a213 |
Groups
acunetix
anthropicbot
awariorssbot
awariosmartbot
bomborabot
bubing
chinaclaw
claude
claudebot
dotbot
diibot
fhscan
mj12bot
mauibot
megaindex.ru
serpstatbot
trendictionbot
sogou spider
sogou web spider
screaming frog seo
veooz
veoozbot
petalbot
ahrefsbot*
blexbot
criteobot*
npbot*
ttd-content
clickagy intelligence*
grapeshot
| Rule | Path |
|---|---|
| Disallow | / |
slurp
yandex
proximic
webnews-arianna
dataforseobot
shopwiki
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
*
googlebot
adsbot-google
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /backup/ |
| Disallow | /banners/ |
| Disallow | /img/ |
| Disallow | /imgdb/banner/ |
| Disallow | /inc/ |
| Disallow | /InterStitial/ |
| Disallow | /link.asp |
| Disallow | /MDB/ |
| Disallow | /radiodwnl/ |
| Disallow | /rating/ |
| Disallow | /rss/ |
| Disallow | /sharedcount/ |
| Disallow | /news/sharedcount/ |
| Disallow | /videoplayer/player/embed/ |
| Disallow | /imgdb/primopiano/impaginate/gallery/ |
| Disallow | /anteprima/ |
| Disallow | /testarea/ |
| Disallow | /POLL/ |
| Disallow | /content/uci/undefined/ |
| Disallow | /%28X%281%29S%28*%29%29/ |
| Disallow | /%28x%281%29s%28* |
| Disallow | *AspxAutoDetectCookieSupport%3D1 |
Comments