libgig.com
robots.txt

Robots Exclusion Standard data for libgig.com

Resource Scan

Scan Details

Site Domain libgig.com
Base Domain libgig.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-22T06:21:05+00:00
Next Scan 2026-03-22T06:21:05+00:00

Last Successful Scan

Scanned2025-08-02T02:15:19+00:00
URL https://libgig.com/robots.txt
Domain IPs 104.21.22.23, 172.67.202.11, 2606:4700:3033::6815:1617, 2606:4700:3035::ac43:ca0b
Response IP 172.67.202.11
Found Yes
Hash e3f693ba7fd837999075d708db88dd1fb3e3567adcb380acd876f12791880065
SimHash 00001b4023d2

Groups

*

Rule Path
Disallow /includes/
Disallow /includes
Disallow /job-search.php
Disallow /job-details.php
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Comments

  • robots.txt for job search