Log In Sign Up

nripage.com
robots.txt

Robots Exclusion Standard data for nripage.com

Resource Scan

Scan Details

Site Domain nripage.com
Base Domain nripage.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-15T02:54:10+00:00
Next Scan 2025-12-22T02:54:10+00:00

Last Successful Scan

Scanned2025-11-14T01:16:31+00:00
URL https://nripage.com/robots.txt
Redirect https://www.nripage.com/robots.txt
Redirect Domain www.nripage.com
Redirect Base nripage.com
Domain IPs 104.26.14.44, 104.26.15.44, 172.67.74.210, 2606:4700:20::681a:e2c, 2606:4700:20::681a:f2c, 2606:4700:20::ac43:4ad2
Redirect IPs 104.26.14.44, 104.26.15.44, 172.67.74.210, 2606:4700:20::681a:e2c, 2606:4700:20::681a:f2c, 2606:4700:20::ac43:4ad2
Response IP 104.26.14.44
Found Yes
Hash a7489707f049365d52885d3a33acb099fb8003bb9c2844e8226810311ebbf866
SimHash 4519f631e795

Groups

googlebot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

duckduckbot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

applebot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

yandexbot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

facebot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

facebookexternalhit

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

twitterbot

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Allow /
Disallow /apidoc/
Disallow /application/
Disallow /cilogs/
Disallow /homepage_assets/
Disallow /images/
Disallow /misc_services/
Disallow /serverlogs/
Disallow /sgsbirdsparadise/
Disallow /site_services/
Disallow /site_theme/
Disallow /system/
Disallow /users_profiles/
Disallow /vendor/
Disallow /url?token=*

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.nripage.com/sitemap.xml
Back to top

Comments

  • robots.txt file to include major search engine bots
Back to top