internetav.com
robots.txt

Robots Exclusion Standard data for internetav.com

Resource Scan

Scan Details

Site Domain internetav.com
Base Domain internetav.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-30T07:35:08+00:00
Next Scan 2026-01-29T07:35:08+00:00

Last Successful Scan

Scanned2025-11-06T18:36:53+00:00
URL https://internetav.com/robots.txt
Redirect https://the70sbistro.com/robots.txt
Redirect Domain the70sbistro.com
Redirect Base the70sbistro.com
Domain IPs 104.21.29.138, 172.67.149.58, 2606:4700:3030::6815:1d8a, 2606:4700:3033::ac43:953a
Redirect IPs 104.21.54.50, 172.67.223.215, 2606:4700:3031::6815:3632, 2606:4700:3035::ac43:dfd7
Response IP 104.21.54.50
Found Yes
Hash 0a24233aad2e31721c39fabe8ea212d86a278791aefcbbb7cda1b481a34f8277
SimHash c816d6c0c701

Groups

*

Rule Path
Allow /$
Allow /promotion
Allow /referrals
Allow /sportsbook
Allow /casino
Allow /idnpoker
Allow /slots
Allow /idnlive
Allow /password/reset
Allow /contact-us
Allow /sitemap.xml
Allow /assets
Disallow /idnlive/lobby

spambot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://the70sbistro.com/sitemap.xml