questionai.com
robots.txt
Robots Exclusion Standard data for questionai.com
Resource Scan
Scan Details
| Site Domain | questionai.com |
| Base Domain | questionai.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T09:45:54+00:00 |
| Next Scan | 2024-11-19T09:45:54+00:00 |
Last Scan
| Scanned | 2024-11-12T09:45:54+00:00 |
| URL | https://questionai.com/robots.txt |
| Domain IPs | 170.106.62.51 |
| Response IP | 170.106.62.51 |
| Found | Yes |
| Hash | 5528bf7e722ae59cc1614d6b73e17fe830d65b7b6e29827fb2df1592d3a2ff60 |
| SimHash | c470d30ca543 |
Groups
googlebot
applebot
bingbot
duckduckbot
naverbot
twitterbot
yandex
facebot
facebookexternalhit
facebookcatalog
oai-searchbot
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | /login?* |
| Disallow | /chat?* |
| Disallow | /useTerm |
| Disallow | /about |
| Disallow | /privacy-policy |
| Disallow | /search?* |
| Disallow | /chatpdf?* |
| Disallow | /textbook-search?* |
| Disallow | /textbook-detail/ |
| Disallow | /textbook-list |
| Disallow | /tbs?* |
| Disallow | /id/ |
| Disallow | /vi/ |
| Disallow | /vn/ |
| Disallow | /ph/ |
| Disallow | /page/ |
| Disallow | /help/ |
| Disallow | /zh-CN/ |
| Disallow | /zh-HK/ |
| Disallow | /en/ |
| Disallow | /fr/ |
| Disallow | /ru/ |
| Disallow | /ar/ |
| Disallow | /nl/ |
| Disallow | /de/ |
| Disallow | /es/ |
| Disallow | /ms/ |
| Disallow | /it/ |
| Disallow | /pt/ |
| Disallow | /ja/ |
| Disallow | /ko/ |
| Disallow | /detail/ |
| Disallow | /favicon.ico |
| Disallow | /questionsno/ |
| Disallow | /video |
| Disallow | /studydocs |
| Disallow | /amp/video |
| Disallow | /amp/studydocs |
| Allow | /subject |
| Allow | /questions |
| Allow | /ask-ai |
| Allow | /book-summary/ |
| Allow | /search |
| Allow | /search-academic |
| Allow | /search-detail/ |
| Allow | /essays |
Warnings
- 1 invalid line.