cadernonacional.com.br
robots.txt
Robots Exclusion Standard data for cadernonacional.com.br
Resource Scan
Scan Details
Site Domain | cadernonacional.com.br |
Base Domain | cadernonacional.com.br |
Scan Status | Ok |
Last Scan | 2024-09-24T15:20:56+00:00 |
Next Scan | 2024-10-01T15:20:56+00:00 |
Last Scan
Scanned | 2024-09-24T15:20:56+00:00 |
URL | https://cadernonacional.com.br/robots.txt |
Domain IPs | 177.136.73.202 |
Response IP | 177.136.73.202 |
Found | Yes |
Hash | 61393d25fabcb187187b6508845179d43a4f8cda50dcfb7b2465a25ab3e64810 |
SimHash | 3c953d09c4f5 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 600 |
googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler
jooblebot
googlebot-news
googlebot-mobile
mediapartners
bingbot
baiduspider
yandexbot
facebot
facebookexternalhit
rogerbot
slurp
duckduckbot
ia_archiver
Rule | Path |
---|---|
Disallow | /includes/ |
Disallow | /misc/ |
Disallow | /modules/ |
Disallow | /profiles/ |
Disallow | /scripts/ |
Disallow | /sites/ |
Disallow | /themes/ |
Disallow | /CHANGELOG.txt |
Disallow | /cron.php |
Disallow | /INSTALL.mysql.txt |
Disallow | /INSTALL.pgsql.txt |
Disallow | /install.php |
Disallow | /INSTALL.txt |
Disallow | /LICENSE.txt |
Disallow | /MAINTAINERS.txt |
Disallow | /update.php |
Disallow | /UPGRADE.txt |
Disallow | /xmlrpc.php |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /contact/ |
Disallow | /logout/ |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /opensearch/ |
Disallow | /user/register/ |
Disallow | /user/password/ |
Disallow | /user/login/ |
Disallow | /?q=admin%2F |
Disallow | /?q=comment%2Freply%2F |
Disallow | /?q=contact%2F |
Disallow | /?q=logout%2F |
Disallow | /?q=node%2Fadd%2F |
Disallow | /?q=search%2F |
Disallow | /?q=user%2Fpassword%2F |
Disallow | /?q=user%2Fregister%2F |
Disallow | /?q=user%2Flogin%2F |
Allow | /feed/cn_feed.xml |
Allow | /sitemap.xml |
Allow | /sitemapcidades.xml |
Allow | /sitemapestados.xml |
Allow | /sitemapvagas.xml |
Allow | /feed/rss.xml |
Allow | /cadcomp.aspx |
Allow | /cadsimp.aspx |
Allow | /vagas.aspx |
Allow | /vagas/ |
Allow | /descricao.aspx |
Allow | /ads/preferences/ |
Allow | /gpt/ |
Allow | /pagead/show_ads.js |
Allow | /pagead/js/adsbygoogle.js |
Allow | /pagead/js/*/show_ads_impl.js |
Allow | /static/glade.js |
Allow | /static/glade/ |
applebot
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
baiduspider
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
bingbot
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch |
discordbot
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch/?v=* |
facebookexternalhit
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch/?v=* |
googlebot
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch |
ia_archiver
Rule | Path |
---|---|
Allow | /about/privacy |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /full_data_use_policy |
Allow | /legal/terms |
Allow | /policy.php |
Allow | /safetycheck/ |
linkedinbot
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch/?v=* |
msnbot
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
naverbot
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
pinterestbot
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch/?v=* |
seznambot
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
slurp
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
teoma
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
telegrambot
Rule | Path |
---|---|
Allow | /*/videos/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Allow | /watch/?v=* |
twitterbot
Rule | Path |
---|---|
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /safetycheck/ |
Comments