ascormovies.com
robots.txt
Robots Exclusion Standard data for ascormovies.com
Resource Scan
Scan Details
| Site Domain | ascormovies.com |
| Base Domain | ascormovies.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-11T20:27:08+00:00 |
| Next Scan | 2024-06-09T20:27:08+00:00 |
Last Successful Scan
| Scanned | 2023-10-20T19:01:14+00:00 |
| URL | https://ascormovies.com/robots.txt |
| Domain IPs | 104.21.82.159, 172.67.203.132, 2606:4700:3032::ac43:cb84, 2606:4700:3033::6815:529f |
| Response IP | 104.21.82.159 |
| Found | Yes |
| Hash | 9a71b94f27fab09cd3a27b5b8465a548ae79fdf02f0fcac46a878c91cb35f50c |
| SimHash | ba434cd1a502 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-includes/ |
| Disallow | /trackback/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /login/ |
| Disallow | /wp-json/ |
| Disallow | /wp-login.php |
| Disallow | *%26preview%3D* |
| Disallow | *?s=* |
| Disallow | *?author=* |
| Disallow | /*.inc |
| Allow | /robots.txt$ |
| Disallow | /*.txt |
| Disallow | /?page_id=5450 |
| Disallow | /apple-app-site-association |
| Disallow | /.well-known/apple-app-site-association |
| Disallow | /sellers.json |
| Disallow | *?wordfence_lh=1&hid=* |
a6-indexer
ahrefsbot
alphaseobot
b-l-i-t-z-b-o-t
barkrowler
boardreader
bomborabot
buck
catexplorador
clickagy
dataprovider
deusu
dnyzbot
domaincrawler
domainsigmacrawler
fbsmtwb
flamingo
garlikcrawler
grapeshotcrawler
java
jooblebot
keybot translation-search-machine
lightspeedsystems
linkpadbot
linqiametadatadownloaderbot
mj12bot
mail.ru_bot
mauibot
megaindex
metauri
netcraft
openlinkprofiler
plukkie
pubmatic crawler bot
seokicks
smtbot
semrushbot
serpstatbot
sirdatabot
siteimprove
surdotlybot
surveybot
synthesio
todoexpertosbot
turnitinbot
tweetmemebot
twingly
urlappendbot
webdatastats
xovibot
yisouspider
zoombot
zoominfobot
cmscrawler
datagnion
grammarly
linkdexbot
linkfluence
ltx71
magpie-crawler
moreover
obot
omgili
panscient
proximic
rogerbot
scrapinghub
sistrix
ubermetrics
vebidoobot
woorankreview
| Rule | Path |
|---|---|
| Disallow | / |
aboundex
adauth
adbeat_bot
adsbot
asafaweb
adnormcrawler
bananabot
blexbot
buzzbot
castlebot
checkmarknetwork
crazywebcrawler-spider
dataprovider
disqusadstxtcrawler
domainappender
domainstatsbot
dotbot
dlvr.it
electricmonk
ezooms
foregenix
grouphigh
hubspot
jamesbot
komodiabot
mixrankbot
nextgensearchbot
pandalytics
probethenet
r6_feedfetcher
rankurbot
ravencrawler
riddler
safednsbot
salesintelligent
sbider
sciencelogic
schemabot
scopia
scoutjet
searchmetricsbot
sentibot
seodiver
serpstatbot
siteexplorer
tweetmemebot
trendictionbot
voltron
zoominfobot
wesee
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ascormovies.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments