thechildrensmediaconference.com
robots.txt
Robots Exclusion Standard data for thechildrensmediaconference.com
Resource Scan
Scan Details
| Site Domain | thechildrensmediaconference.com |
| Base Domain | thechildrensmediaconference.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T07:36:17+00:00 |
| Next Scan | 2024-10-25T07:36:17+00:00 |
Last Scan
| Scanned | 2024-09-25T07:36:17+00:00 |
| URL | https://thechildrensmediaconference.com/robots.txt |
| Redirect | https://www.thechildrensmediaconference.com/thechildrensmediaconference.com/robots.txt |
| Redirect Domain | www.thechildrensmediaconference.com |
| Redirect Base | thechildrensmediaconference.com |
| Domain IPs | 34.149.36.179, 34.160.17.71, 35.190.31.54, 35.244.153.44 |
| Redirect IPs | 34.160.81.203, 35.190.31.54, 35.227.194.51, 35.244.153.44 |
| Response IP | 34.120.190.48 |
| Found | Yes |
| Hash | f631939df906e866fc34aa00cd935ae650e00c9db8d1cead35f8c15102cb1041 |
| SimHash | 4a0cdaf3e0b9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-content/ |
| Disallow | /wp-includes/ |
| Disallow | /login/ |
| Disallow | /wp-cron.php |
| Disallow | /wp-cron.php?* |
| Disallow | /xmlrpc.php |
| Disallow | /?s= |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 100 |
*
| Rule | Path |
|---|---|
| Disallow | /*.pdf$ |
| Disallow | /*.csv$ |
| Disallow | /*.pdf?* |
| Disallow | /*.csv?* |
aaabot
ahrefsbot
anderspinkbot
bidswitchbot
blp_bbot
blp_bbot/0.1
blp_bbot/0.1
buck
ccbot
dotbot
eyemonit
eyemonit_bot
eyemonit_bot_version_0.1_(http://www.eyemon.it/)
eyemonit uptime bot mozilla/5.0
eyemonit uptime bot mozilla/5.0 (windows nt 10.0; win64; x64) applewebkit/537.36 (khtml, like gecko) chrome/74.0.3729.169 safari/537.36
fullstorybot/1.0
fullstorybot/1.0 (+https://www.fullstory.com)
gsa-crawler+(enterprise;+t3-hr8mk3s756etj;+google-support@extended-content.com)
linespider
mail.ru
mediatoolkitbot
megaindex.ru
mj12bot
moatbot
moodlebot
moodlebot/1.0
neevabot
seekport
semrushbot
seostar
serpstatbot
seznambot
special_archiver
taboolabot
voluumdsp-content-bot
zoombot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler
facebookexternalhit
twitterbot
applebot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-content/ |
| Disallow | /wp-includes/ |
| Disallow | /login/ |
| Disallow | /wp-cron.php |
| Disallow | /xmlrpc.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thechildrensmediaconference.com/sitemap_index.xml |