Well-Known Resource Index

Terms

nytimes.com aol.com

Search by domain, resource type, IP, simhash, etc., as well as assorted resource-specific fields. When there are multiple terms only one needs to match.

Phrases

"display video"

Surround terms in quotes to search for a phrase.

Require and Exclude

nytimes.com aol.com +ads_txt

Add + before a term or phrase to require it, or - to exclude it.

Prefix

nyt*

Add * after a term or phrase to search by prefix.

Filters

resource:ads_txt nytimes.com

Filters restrict results based on specific fields. They are written in the form [filter]:[value].

Most filters accept terms or phrases as values (including support for prefixes). Providing only * as a value will match resources where the relevant field exists, regardless of its value.

Some filters can only check if a field exists, so only work with * value. Others filter on boolean fields, so only work with true or false.

Exclude and Optional

-resource:ads_txt nytimes.com

Filters act as required terms by default, but can be excluded instead by adding - before the filter.

nytimes.com ~domain:aol.com

Filters can also made optional adding ~ before the filter.

Multiple Options

resource:(ads_txt app_ads_txt) nytimes.com

Wrap terms or phrases in parenthesis to supply multiple options to a filter. Only one option needs to match.

Integer Filters

rank:<10 resource:ads_txt

Integer filters accept whole numbers.

Prefix the number with <, <=, >, or >= to filter by range.

Date Filters

scanned:>=2021-06-01 nytimes.com

Date filters accept RFC3339 formated dates in UTC.

Prefix the date with <, <=, >, or >= to filter by range.

IP Filters

response_ip:199.232.45.164

IP filters accept IP addresses, and subnets in CIDR notation.

Global Filters

domain:[value]
Filter by domain name.

resource:[value]
Filter by resource type.

status:[ok|failed]
Filter by resource scan status.

scanned:[date]
Filter by resource scan date.

scheme:[https|http]
Filter by the scheme the resource was found under.

is_www:[true|false]
Filter by whether the resource was found on the www subdomain.

base_domain:[value]
Filter by base domain (eTLD+1).

is_base_domain:[true|false]
Filter by whether the domain is the base domain.
The www subdomain is considered the base domain.

rank:[integer]
Filter by Tranco list rank of the base domain.
The top 100,000 domains are ranked.

etld:[value]
Filter by effective top-level domain (eTLD).

redir_domain:[value]
Filter by final redirect domain name, if any.

redir_base_domain:[value]
Filter by final redirect base domain (eTLD+1), if any.

redir_etld:[value]
Filter by final redirect effective top-level domain (eTLD), if any.

domain_ip:[ip]
Filter by ip address of the domain name (from DNS).

redir_ip:[ip]
Filter by ip address of the redirect domain name (from DNS), if any.

response_ip:[ip]
Filter by ip address of the responding server.

hash:[value]
Filter by resource sha256 hex digest.

simhash:[value]
Filter by resource simhash.

simhash_near:[value]
Filter by resource simhash, allowing similar simhashes.
Only works with full simhashes, not prefixes.

Authorized Digital Sellers

/ads.txt (spec)

Defined by the IAB Tech Lab, ads.txt allows sites to specify which ad system accounts are authorized to sell their ad inventory.

Resource Filter

resource:ads_txt
Filter to only Authorized Digital Sellers resources.

Record Filters

Filter by the ad account records listed in ads.txt resources.

ads_system:[value]
Filter by ad system domain.

ads_system_direct:[value]
Same as ads_system, but only match systems listed in DIRECT records.

ads_system_reseller:[value]
Same as ads_system, but only match systems listed in RESELLER records.

ads_seller:[value]
Filter by seller ID.

ads_account:[value]
Filter by the full account ID, in the form [ad system]|[seller id].

ads_direct:[value]
Same as ads_account, but only match accounts listed in DIRECT records.

ads_reseller:[value]
Same as ads_account, but only match accounts listed in RESELLER records.

ads_cid:[value]
Filter by certification authority ID.

ads_extension:[value]
Filter by record extension data.

ads_inline_comment:[value]
Filter by comments at the end of record lines.

ads_placeholder:[true|false]
Filter by placeholder record presence.

ads_comment:[value]
Filter by standalone comments.

Variable Filters

Filter by the variables included in ads.txt resources.

ads_contact:[value]
Filter by the contact variable.

ads_contact_comment:[value]
Filter by comments at the end of contact variable lines.

ads_subdomain:[value]
Filter by the subdomain variable.

ads_subdomain_comment:[value]
Filter by comments at the end of subdomain variable lines.

ads_partner:[value]
Filter by the inventory partner domain variable.

ads_partner_comment:[value]
Filter by comments at the end of inventory partner domain variable lines.

ads_owner:[value]
Filter by the owner domain variable.

ads_owner_comment:[value]
Filter by comments at the end of owner domain variable lines.

ads_manager:[value]
Filter by the manager domain variable.

ads_manager_country:[value]
Filter by manager domain variable country code.

ads_manager_comment:[value]
Filter by comments at the end of manager domain variable lines.

Stats Filters

ads_record_count:[integer]
Filter by number of records.

ads_account_count:[integer]
Filter by number of unique authorized accounts.

ads_direct_count:[integer]
Same as ads_account_count, but only count accounts listed in DIRECT records.

ads_reseller_count:[integer]
Same as ads_account_count, but only count accounts listed in RESELLER records.

ads_system_count:[integer]
Filter by number of unique authorized ad systems.

ads_system_direct_count:[integer]
Same as ads_system_count, but only count ad systems listed in DIRECT records.

ads_system_reseller_count:[integer]
Same as ads_system_count, but only count ad systems listed in RESELLER records.

ads_contact_count:[integer]
Filter by number of CONTACT variables.

ads_subdomain_count:[integer]
Filter by number of SUBDOMAIN variables.

ads_partner_count:[integer]
Filter by number of INVENTORYPARTNERDOMAIN variables.

ads_owner_count:[integer]
Filter by number of OWNERDOMAIN variables.

ads_manager_count:[integer]
Filter by number of MANAGERDOMAIN variables.

Authorized Digital Sellers for Apps

/app-ads.txt (spec)

Defined by the IAB Tech Lab, app-ads.txt allows app developers to specify which ad system accounts are authorized to sell their apps' ad inventory.

Resource Filter

resource:app_ads_txt
Filter to only Authorized Digital Sellers for Apps resources.

Record Filters

Filter by the ad account records listed in app-ads.txt resources.

aads_system:[value]
Filter by ad system domain.

aads_system_direct:[value]
Same as aads_system, but only match systems listed in DIRECT records.

aads_system_reseller:[value]
Same as aads_system, but only match systems listed in RESELLER records.

aads_seller:[value]
Filter by seller ID.

aads_account:[value]
Filter by the full account ID, in the form [ad system]|[seller id].

aads_direct:[value]
Same as aads_account, but only match accounts listed in DIRECT records.

aads_reseller:[value]
Same as aads_account, but only match accounts listed in RESELLER records.

aads_cid:[value]
Filter by certification authority ID.

aads_extension:[value]
Filter by record extension data.

aads_inline_comment:[value]
Filter by comments at the end of record lines.

aads_placeholder:[true|false]
Filter by placeholder record presence.

aads_comment:[value]
Filter by standalone comments.

Variable Filters

Filter by the variables included in app-ads.txt resources.

aads_contact:[value]
Filter by the contact variable.

aads_contact_comment:[value]
Filter by comments at the end of contact variable lines.

aads_partner:[value]
Filter by the inventory partner domain variable.

aads_partner_comment:[value]
Filter by comments at the end of inventory partner domain variable lines.

aads_owner:[value]
Filter by the owner domain variable.

aads_owner_comment:[value]
Filter by comments at the end of owner domain variable lines.

aads_manager:[value]
Filter by the manager domain variable.

aads_manager_country:[value]
Filter by manager domain variable country code.

aads_manager_comment:[value]
Filter by comments at the end of manager domain variable lines.

Stats Filters

aads_record_count:[integer]
Filter by number of records.

aads_account_count:[integer]
Filter by number of unique authorized accounts.

aads_direct_count:[integer]
Same as aads_account_count, but only count accounts listed in DIRECT records.

aads_reseller_count:[integer]
Same as aads_account_count, but only count accounts listed in RESELLER records.

aads_system_count:[integer]
Filter by number of unique authorized ad systems.

aads_system_direct_count:[integer]
Same as aads_system_count, but only count ad systems listed in DIRECT records.

aads_system_reseller_count:[integer]
Same as aads_system_count, but only count ad systems listed in RESELLER records.

aads_contact_count:[integer]
Filter by number of CONTACT variables.

aads_partner_count:[integer]
Filter by number of INVENTORYPARTNERDOMAIN variables.

aads_owner_count:[integer]
Filter by number of OWNERDOMAIN variables.

aads_manager_count:[integer]
Filter by number of MANAGERDOMAIN variables.

Apple Associated Domain

/.well-known/apple-app-site-association (spec)

An Apple specification that allows a site to define its relationship to Apple platform apps, e.g. allow links to a site to be opened in an app instead.

Resource Filter

resource:apple_app_site_association
Filter to only Apple Associated Domain resources.

Web Credential Filters

Filter by the webcredential data in apple-app-site-association resources.

asa_webcredential_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id].

asa_webcredential_app_prefix:[value]
Filter by app ID prefix.

asa_webcredential_bundle:[value]
Filter by bundle ID.

App Clip Filters

Filter by the appclip data in apple-app-site-association resources.

asa_appclip_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id].

asa_appclip_app_prefix:[value]
Filter by app ID prefix.

asa_appclip_bundle:[value]
Filter by bundle ID.

App Link Filters

Filter by the applink data in apple-app-site-association resources.

asa_applink_default:*
Filter by whether any domain-level defaults are set.

asa_applink_substitution:*
Filter by whether any substitution variables are defined.

asa_applink_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id].

asa_applink_app_prefix:[value]
Filter by app ID prefix.

asa_applink_bundle:[value]
Filter by bundle ID.

asa_applink_app_default:*
Filter by whether any app-level defaults are set.

asa_applink_path:*
Filter by whether components define a path pattern.

asa_applink_query:*
Filter by whether components define a query pattern.

asa_applink_fragment:*
Filter by whether components define a fragment pattern.

asa_applink_exclude:[true|false]
Filter by component exclude value.

asa_applink_case_sensitive:[true|false]
Filter by component case sensitive value.

asa_applink_percent_encoded:[true|false]
Filter by component percent encoded value.

asa_applink_comment:[value]
Filter by component comment.

Digital Asset Links

/.well-known/assetlinks.json (spec)

A Google specification that allows a site to define its relationship to apps or other sites, e.g. allow links to a site to be opened in an app instead.

Resource Filter

resource:assetlinks
Filter to only Digital Asset Links resources.

Filters

Filter by the asset links listed in assetlinks.json resources.

dal_relation:[value]
Filter by link relation type.

dal_target_namespace:[value]
Filter by link target namespace.
Namespaces: web, android_app, ios_app

dal_target_package:[value]
Filter by link target android package name, for andoid_app links.

dal_target_appid:[value]
Filter by link target iOS app ID, for ios_app links.

dal_include:*
Filter by whether any external assetlink.json resources are included.

Global Privacy Control

/.well-known/gpc.json (spec)

The Global Privacy Control is a signal user agents can send to sites, requesting that their personal information is not sold or shared with third parties. The gpc.json resource allows sites to indicate whether they respect the Global Privacy Control signal.

Resource Filter

resource:gpc
Filter to only Global Privacy Control resources.

Filters

Filter by the asset links listed in gpc.json resources.

gpc_support:[true|false]
Filter by whether GPC is supported.

gpc_update:*
Filter by whether a last update date/time is provided.

NodeInfo

/.well-known/nodeinfo (spec)

NodeInfo is a standardized way of exposing metadata about a server running one of a number of distributed social networks.

Resource Filter

resource:nodeinfo
Filter to only NodeInfo resources.

NodeInfo Filters

Filter by the details of the NodeInfo resource.

ndi_version:[value]
Filter by NodeInfo schema version.

ndi_metadata:*
Filter by whether extra metadata is provided.

Usage Filters

Filter by usage statistics of the server.

ndi_user_count:[integer]
Filter by the number of registered users.

ndi_user_180d_count:[integer]
Filter by the number of active users in the last 180 days.

ndi_user_30d_count:[integer]
Filter by the number of active users in the last 30 days.

ndi_post_count:[integer]
Filter by the number of posts made by local users.

ndi_comment_count:[integer]
Filter by the number of comments made by local users.

Server Filters

Filter by the details about the server.

ndi_software:[value]
Filter by server software, in the form [name]|[version].

ndi_software_name:[value]
Filter by server software name.

ndi_software_version:[value]
Filter by server software version.

ndi_software_repository:*
Filter by whether a server software repository is provided.

ndi_software_homepage:*
Filter by whether a server software homepage is provided.

ndi_protocol:[value]
Filter by supported protocol.

ndi_service:[value]
Filter by 3rd party sites this server can connect to.

ndi_service_inbound:[value]
Filter by 3rd party sites this server can retrieve messages from.

ndi_service_outbound:[value]
Filter by 3rd party sites this server can publish messages to.

ndi_open:[true|false]
Filter by whether the server is open for self-registration.

OpenID Provider Configuration

/.well-known/openid-configuration (spec)

An OpenID Provider Configuration resource includes metadata about an OpenID Connect provider, allowing clients to configure themselves to use the provider.

Resource Filter

resource:openid_configuration
Filter to only OpenID Provider Configuration resources.

Exists Filters

oid_authorization_endpoint:*
Filter by whether an authorization endpoint is provided.

oid_token_endpoint:*
Filter by whether a token endpoint is provided.

oid_userinfo_endpoint:*
Filter by whether a userinfo endpoint is provided.

oid_jwks_uri:*
Filter by whether a JSON Web Key Set URI is provided.

oid_registration_endpoint:*
Filter by whether a registration endpoint is provided.

oid_service_documentation:*
Filter by whether a service documentation URI is provided.

oid_policy_uri:*
Filter by whether a data policy URI is provided.

oid_tos_uri:*
Filter by whether a terms of service URI is provided.

Boolean Filters

oid_claims_parameter:[true|false]
Filter by whether the claims parameter is supported.

oid_request_parameter:[true|false]
Filter by whether the request parameter is supported.

oid_request_uri_parameter:[true|false]
Filter by whether the request_uri parameter is supported.

oid_require_request_uri_registration:[true|false]
Filter by whether request_uri parameter values must be pre-registered.

Text Filters

oid_scope:[value]
Filter by supported scopes.

oid_response_type:[value]
Filter by supported response types.

oid_response_mode:[value]
Filter by supported response modes.

oid_grant_type:[value]
Filter by supported grant types.

oid_acr:[value]
Filter by supported Authentication Context Class References.

oid_subject_type:[value]
Filter by supported subject types.

oid_display:[value]
Filter by supported display parameter values.

oid_claim_type:[value]
Filter by supported claim types.

oid_claim:[value]
Filter by supported claims.

oid_claims_locale:[value]
Filter by supported languages for claim values.

oid_ui_locale:[value]
Filter by supported languages for the user interface.

oid_id_token_signing_alg:[value]
Filter by supported token signing algorithms.

oid_id_token_encryption_alg:[value]
Filter by supported token encryption algorithms (alg values).

oid_id_token_encryption_enc:[value]
Filter by supported token encryption algorithms (enc values).

oid_id_userinfo_signing_alg:[value]
Filter by supported userinfo signing algorithms.

oid_id_userinfo_encryption_alg:[value]
Filter by supported userinfo encryption algorithms (alg values).

oid_id_userinfo_encryption_enc:[value]
Filter by supported userinfo encryption algorithms (enc values).

oid_id_request_object_signing_alg:[value]
Filter by supported request object signing algorithms.

oid_id_request_object_encryption_alg:[value]
Filter by supported request object encryption algorithms (alg values).

oid_id_request_object_encryption_enc:[value]
Filter by supported request object encryption algorithms (enc values).

oid_token_endpoint_auth_method:[value]
Filter by supported token endpoint authentication methods.

oid_token_endpoint_auth_signing_alg:[value]
Filter by supported token endpoint authentication signing algorithms.

Robots Exclusion Standard

/robots.txt (spec)

An informal standard that allows sites to ask web crawlers to not crawl certain urls.

Resource Filter

resource:robots_txt
Filter to only Robots Exclusion Standard resources.

Filters

rbt_product:[value]
Filter by robot product tokens (User-Agent values).

rbt_product_comment:[value]
Filter by comments at the end of User-Agent lines.

rbt_rule_pattern:[value]
Filter by path patterns (Allow/Disallow values).

rbt_rule_comment:[value]
Filter by comments at the end of Allow/Disallow lines.

rbt_allow_rule:[value]
Filter by Allow rules, in the form [product token]|[path pattern].

rbt_disallow_rule:[value]
Filter by Disallow rules, in the form [product token]|[path pattern].

rbt_crawldelay:*
Filter by whether any Crawl-delay lines are present.

rbt_crawldelay_comment:[value]
Filter by comments at the end of Crawl-delay lines.

rbt_sitemap:*
Filter by whether any Sitemap lines are present.

rbt_sitemap_comment:[value]
Filter by comments at the end of Sitemap lines.

rbt_comment:[value]
Filter by standalone comments.

security.txt

/.well-known/security.txt (spec)

Allows sites to communicate their security policies, e.g. how to report a vulnerability.

Resource Filter

resource:security_txt
Filter to only security.txt resources.

Filters

sec_signed:[true|false]
Filter by whether the security.txt resource is signed.

sec_signer:[value]
Filter by the IDs of the keys used to sign the resource.

sec_acknowledge:*
Filter by whether an acknowledgments URI is provided.

sec_canonical:*
Filter by whether a canonical URI is provided.

sec_contact:*
Filter by whether a contact URI is provided.

sec_encryption:*
Filter by whether an encryption key URI is provided.

sec_expires:*
Filter by whether an expires datetime is provided.

sec_hiring:*
Filter by whether a hiring URI is provided.

sec_policy:*
Filter by whether a disclosure policy URI is provided.

sec_policy:[value]
Filter by the preferred languages listed.

trust.txt

/.well-known/trust.txt (spec)

Allows publishers to declare connections to other publishers and associations.

Resource Filter

resource:trust_txt
Filter to only trust.txt resources.

Other Filters

tst_social:*
Filter by whether any social lines are present.

tst_social_comment:[value]
Filter by comments at the end of social lines.

tst_contact:*
Filter by whether any contact lines are present.

tst_contact_comment:[value]
Filter by comments at the end of contact lines.

tst_datatrainingallowed:[true|false]
Filter by whether data training is allowed.

tst_datatrainingallowed_comment:[value]
Filter by comments at the end of datatrainingallowed lines.

tst_comment:[value]
Filter by standalone comments.

Connection Filters

tst_member:[value]
Filter by domain in member URIs.

tst_member_path:[value]
Filter by path in member URIs.

tst_member_comment:[value]
Filter by comments at the end of member lines.

tst_belongto:[value]
Filter by domain in belongto URIs.

tst_belongto_path:[value]
Filter by path in belongto URIs.

tst_belongto_comment:[value]
Filter by comments at the end of belongto lines.

tst_control:[value]
Filter by domain in control URIs.

tst_control_path:[value]
Filter by path in control URIs.

tst_control_comment:[value]
Filter by comments at the end of control lines.

tst_controlledby:[value]
Filter by domain in controlledby URIs.

tst_controlledby_path:[value]
Filter by path in controlledby URIs.

tst_controlledby_comment:[value]
Filter by comments at the end of controlledby lines.

tst_vendor:[value]
Filter by domain in vendor URIs.

tst_vendor_path:[value]
Filter by path in vendor URIs.

tst_vendor_comment:[value]
Filter by comments at the end of vendor lines.

tst_customer:[value]
Filter by domain in customer URIs.

tst_customer_path:[value]
Filter by path in customer URIs.

tst_customer_comment:[value]
Filter by comments at the end of customer lines.