twinksbang.com
robots.txt

Robots Exclusion Standard data for twinksbang.com

Resource Scan

Scan Details

Site Domain twinksbang.com
Base Domain twinksbang.com
Scan Status Ok
Last Scan2024-06-13T11:46:07+00:00
Next Scan 2024-07-13T11:46:07+00:00

Last Scan

Scanned2024-06-13T11:46:07+00:00
URL https://twinksbang.com/robots.txt
Domain IPs 104.21.235.111, 104.21.235.112, 2606:4700:3038::6815:eb6f, 2606:4700:3038::6815:eb70
Response IP 104.21.235.112
Found Yes
Hash 1f4088da255b4b9c338d80b094e65db8aef49efde47cf39698dbcf2e6a3c670e
SimHash 031cdc10c1c3

Groups

*

Rule Path
Disallow /te3/
Disallow /get_file/
Disallow /player/embed_null.php
Disallow /404.php
Disallow /login.php
Disallow /signup.php
Disallow /upgrade.php
Disallow /redirect_cs.php
Disallow /members/
Disallow /activity/
Disallow /groups/
Disallow /admin-ajax.php
Disallow /wp-admin/
Disallow /ajax.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://twinksbang.com/video-sitemap.xml
sitemap https://twinksbang.com/xmlsitemap.xml

Warnings

  • 2 invalid lines.