incarabia.com
robots.txt

Robots Exclusion Standard data for incarabia.com

Resource Scan

Scan Details

Site Domain incarabia.com
Base Domain incarabia.com
Scan Status Ok
Last Scan2024-11-15T12:12:32+00:00
Next Scan 2024-11-22T12:12:32+00:00

Last Scan

Scanned2024-11-15T12:12:32+00:00
URL https://incarabia.com/robots.txt
Redirect https://www.incarabia.com/robots.txt/
Redirect Domain www.incarabia.com
Redirect Base incarabia.com
Domain IPs 104.21.62.131, 172.67.136.42, 2606:4700:3030::ac43:882a, 2606:4700:3034::6815:3e83
Redirect IPs 104.21.62.131, 172.67.136.42, 2606:4700:3030::ac43:882a, 2606:4700:3034::6815:3e83
Response IP 172.67.136.42
Found Yes
Hash 6c1d1fd4f3eb9574156a60e08dc9acad89096e824ab638e5a736e21b58ce76c5
SimHash 01e65c814c54

Groups

*

Rule Path
Disallow /*?d=*
Disallow /*.pdf
Disallow /*.php
Disallow /archive/*
Disallow /search/*
Disallow /ajax/*
Disallow /js/*
Disallow /themes/*
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /latest_news/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /?q=latest_news%2F
Disallow /rate/

meltawer

Rule Path
Disallow /

digimind

Rule Path
Disallow /

knowings

Rule Path
Disallow /

sindup

Rule Path
Disallow /

cision

Rule Path
Disallow /

talkwater

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

kbcrawl

Rule Path
Disallow /

amisoftware

Rule Path
Disallow /

newzbin

Rule Path
Disallow /

ask n read

Rule Path
Disallow /

qwam content intelligence

Rule Path
Disallow /

zite

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

youmag

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

trendybuzz

Rule Path
Disallow /

spotter

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

augure

Rule Path
Disallow /

corporama

Rule Path
Disallow /

readability.com

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

libwww

Rule Path
Disallow /

wget

Rule Path
Disallow /

adequat

Rule Path
Disallow /

adequat-systems

Rule Path
Disallow /

auramundi

Rule Path
Disallow /

coexel

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

mention

Rule Path
Disallow /

moreover

Rule Path
Disallow /

mytwip

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

newzbin

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

proxem

Rule Path
Disallow /

score3

Rule Path
Disallow /

trendeo

Rule Path
Disallow /

vecteurplus

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

vsw

Rule Path
Disallow /

winello

Rule Path
Disallow /

fetch

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

asknread.com

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

spotter

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.incarabia.com/media_sitemap.xml

Comments

  • Robots excluded from indexing

Warnings

  • 4 invalid lines.