zeptomath.com
robots.txt
Robots Exclusion Standard data for zeptomath.com
Resource Scan
Scan Details
| Site Domain | zeptomath.com |
| Base Domain | zeptomath.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T04:17:35+00:00 |
| Next Scan | 2024-12-08T04:17:35+00:00 |
Last Scan
| Scanned | 2024-11-08T04:17:35+00:00 |
| URL | https://zeptomath.com/robots.txt |
| Domain IPs | 104.21.29.222, 172.67.149.216, 2606:4700:3030::6815:1dde, 2606:4700:3031::ac43:95d8 |
| Response IP | 104.21.29.222 |
| Found | Yes |
| Hash | 2f6580d1aadb56e4f7e0a41610e6ad07cc7dccae7b0c6c53587c27ee33543e11 |
| SimHash | 2c16c760a294 |
Groups
bingbot
slurp
coccocbot
duckduckbot
baiduspider
applebot
| Product | Comment |
|---|---|
| bingbot | Bing |
| slurp | Yahoo |
| coccocbot | Vietnam |
| duckduckbot | DuckDuckGo |
| baiduspider | China |
| applebot | Apple |
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Allow | / |
seznambot
naverbot
yeti
mail.ru
sogou
neevabot
| Product | Comment |
|---|---|
| seznambot | Czech Republic |
| naverbot | South Korea |
| yeti | South Korea |
| mail.ru | Russia |
| sogou | China |
| neevabot | Neeva |
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
teoma
sputnikbot
daumoa
dazoobot
deusu
euripbot
exploratodo
istellabot
moget
ichiro
petalbot
amazonbot
| Product | Comment |
|---|---|
| teoma | Ask |
| sputnikbot | Russia |
| daumoa | South Korea |
| dazoobot | France |
| deusu | Germany |
| euripbot | Europe |
| exploratodo | Latin America |
| istellabot | Italy |
| moget | Japan |
| ichiro | Japan |
| petalbot | Huawei |
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot-news
googlebot-video
googlebot-image
adsbot-google
bingpreview
msnbot
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Allow | / |
mediapartners-google
ias_crawler
grapeshotcrawler
criteobot
ttd-content
weborama-fetcher
amazonadbot
leikibot
doubleverify
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.
Comments