inliber.com
robots.txt

Robots Exclusion Standard data for inliber.com

Resource Scan

Scan Details

Site Domain inliber.com
Base Domain inliber.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-02-01T20:53:42+00:00
Next Scan 2026-02-08T20:53:42+00:00

Last Successful Scan

Scanned2026-01-24T20:43:41+00:00
URL https://inliber.com/robots.txt
Redirect https://www.inliber.com/robots.txt
Redirect Domain www.inliber.com
Redirect Base inliber.com
Domain IPs 104.21.79.191, 172.67.171.2, 2606:4700:3032::ac43:ab02, 2606:4700:3033::6815:4fbf
Redirect IPs 104.21.79.191, 172.67.171.2, 2606:4700:3032::ac43:ab02, 2606:4700:3033::6815:4fbf
Response IP 172.67.171.2
Found Yes
Hash 6db3b9f1f380ab592a5ab5add74b475bf1d8b0429561047b513cc56207694446
SimHash 721cd551b4b2

Groups

yandex

Rule Path
Disallow /id/
Disallow *?page
Disallow /*/search
Disallow /*/artists
Disallow /*/album
Disallow /search
Disallow /*?page=
Disallow /*/profile
Disallow /*/archives
Disallow /*/popular
Disallow /*/categories
Disallow /*/login
Disallow /*/register
Disallow /*/forgot-password

googlebot

Rule Path
Disallow /
Disallow *
Disallow /*/search
Disallow /*/artists
Disallow /*/album
Disallow /search
Disallow /*?page=
Disallow /*/profile
Disallow /*/archives
Disallow /*/popular
Disallow /*/categories
Disallow /*/login
Disallow /*/register
Disallow /*/forgot-password

*

Rule Path
Disallow *?page
Disallow /*/search
Disallow /search
Disallow /*/artists
Disallow /*/album
Disallow /*?page=
Disallow /*/profile
Disallow /*/archives
Disallow /*/popular
Disallow /*/categories
Disallow /*/login
Disallow /*/register
Disallow /*/forgot-password

googlebot
semrushbot
dataforseobot
dotbot
ahrefsbot
barkrowler
mj12bot
trendictionbot
bytespider
baiduspider
blexbot
awariobot
velenpublicwebcrawler
semrushbot-eo
semrushbot-ba
turnitinbot
seopultcontentanalyzer
serpstatbot/2.1
ccbot/2.0
meltwaternews
academicbotrtu
screaming frog seo spider/20.2
screaming frog seo spider/16.7
owler
amazonbot
peer39_crawler/1.0
miralinks robot
crawler_eb_germany_2.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://inliber.com/en/google-news-sitemap.xml
sitemap https://inliber.com/ru/google-news-sitemap.xml
sitemap https://inliber.com/id/google-news-sitemap.xml
sitemap https://inliber.com/uz/google-news-sitemap.xml
sitemap https://inliber.com/en/google-news-sitemap.xml
sitemap https://inliber.com/ru/google-news-sitemap.xml
sitemap https://inliber.com/id/google-news-sitemap.xml
sitemap https://inliber.com/uz/google-news-sitemap.xml