beursig.com
robots.txt

Robots Exclusion Standard data for beursig.com

Resource Scan

Scan Details

Site Domain beursig.com
Base Domain beursig.com
Scan Status Ok
Last Scan2024-10-06T01:06:48+00:00
Next Scan 2024-10-13T01:06:48+00:00

Last Scan

Scanned2024-10-06T01:06:48+00:00
URL https://beursig.com/robots.txt
Domain IPs 104.21.34.167, 172.67.163.73, 2606:4700:3031::ac43:a349, 2606:4700:3035::6815:22a7
Response IP 172.67.163.73
Found Yes
Hash 63d8c0551846fc8c1ba7cac74151776d63ae416c08d5e86ace10a8836b5afd41
SimHash ee409866699a

Groups

*

Rule Path
Disallow /2017/03/27/wegwijs-forum-overzicht-functies
Disallow /2015/01/01/beleggers-nieuwsbrief/
Disallow /contact
Disallow /forum/app.php/mchat
Disallow /forum/app.php/mchat/archive
Disallow /forum/memberlist.php
Disallow /forum/mcp.php
Disallow /forum/posting.php
Disallow /forum/report.php
Disallow /forum/search.php
Disallow /forum/ucp.php
Disallow /forum/ucp.php?i=pm&folder=inbox
Disallow /forum/ucp.php?mode=register
Disallow /forum/ucp.php?mode=login
Disallow /forum/viewonline.php

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://beursig.com/sitemap_index.xml
sitemap https://beursig.com/sitemap.xml