deals.kinja.com
robots.txt

Robots Exclusion Standard data for deals.kinja.com

Resource Scan

Scan Details

Site Domain deals.kinja.com
Base Domain kinja.com
Scan Status Ok
Last Scan2024-05-06T01:41:42+00:00
Next Scan 2024-06-05T01:41:42+00:00

Last Scan

Scanned2024-05-06T01:41:42+00:00
URL https://deals.kinja.com/robots.txt
Redirect https://theinventory.com/robots.txt
Redirect Domain theinventory.com
Redirect Base theinventory.com
Domain IPs 151.101.130.166, 151.101.194.166, 151.101.2.166, 151.101.66.166
Redirect IPs 151.101.130.166, 151.101.194.166, 151.101.2.166, 151.101.66.166
Response IP 151.101.66.166
Found Yes
Hash fc70ae83d9727de8d23cb2c795a923cac404d180c52d4db68e9d41292e78104d
SimHash 09145851ef92

Groups

*

Rule Path
Disallow /stats/
Disallow /api/
Disallow /ajax/
Disallow /embed/
Disallow /setbucket*
Disallow /game/score/*
Disallow /game/summary/*
Disallow /advisor/*
Allow /advisor/sitemap.xml
Disallow /search$
Disallow /search?

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://theinventory.com/sitemap.xml