getjetso.com
robots.txt

Robots Exclusion Standard data for getjetso.com

Resource Scan

Scan Details

Site Domain getjetso.com
Base Domain getjetso.com
Scan Status Ok
Last Scan2025-05-02T17:24:26+00:00
Next Scan 2025-05-09T17:24:26+00:00

Last Scan

Scanned2025-05-02T17:24:26+00:00
URL https://getjetso.com/robots.txt
Redirect https://www.getjetso.com/robots.txt
Redirect Domain www.getjetso.com
Redirect Base getjetso.com
Domain IPs 104.21.234.156, 104.21.234.157, 2606:4700:3038::6815:ea9c, 2606:4700:3038::6815:ea9d
Redirect IPs 104.21.234.156, 104.21.234.157, 2606:4700:3038::6815:ea9c, 2606:4700:3038::6815:ea9d
Response IP 104.21.234.157
Found Yes
Hash ea45492cc61eca75a473d85f50543e76d398b317f7eeb74d066a8b24c4cc31a4
SimHash a27c8473c0a1

Groups

blexbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Allow /forum/
Disallow /test2.php
Disallow /test3.php
Disallow /xanga.php
Disallow /xangalog.txt
Disallow /lib/
Disallow /cache/
Disallow /admin/
Disallow /jetso/
Disallow /ad-zone/
Disallow /forum/api/
Disallow /forum/customavatars/
Disallow /forum/images/
Disallow /forum/install/
Disallow /forum/forumdata/
Disallow /forum/include/
Disallow /forum/ipdata/
Disallow /forum/templates/
Disallow /forum/plugins/
Disallow /forum/mspace/
Disallow /forum/wap/
Disallow /forum/wap/index.php
Disallow /forum/admincp.php
Disallow /forum/ajax.php
Disallow /forum/digest.php
Disallow /forum/member.php
Disallow /forum/memcp.php
Disallow /forum/misc.php
Disallow /forum/my.php
Disallow /forum/pm.php
Disallow /forum/post.php
Disallow /forum/faq.php
Disallow /forum/register.php
Disallow /forum/search.php
Disallow /forum/seccode.php
Disallow /forum/topicadmin.php
Disallow /forum/modcp.php
Disallow /forum/fb-connect.php
Disallow /forum/google-login.php
Disallow /forum/advertise.php
Disallow /forum/url.php

Other Records

Field Value
crawl-delay 30