Nodals Bot User-Agent Policy

User-Agent

NodalsBot/1.0 (+https://nodals.ai/nodalsbot)

Purpose

NodalsBot is the official web crawler of Nodals AI, used to index and analyse customer websites for advertising technology.

Respect for Robots.txt

NodalsBot fully obeys the robots.txt standard.

Polite Crawling

Our crawler is designed to minimize server load by limiting request rates and respecting crawl-delay directives where specified.

Scope

NodalsBot only crawls websites where Nodals AI has a business relationship or explicit permission.

Identifying NodalsBot

All requests will carry the following User-Agent header:

NodalsBot/1.0 (+https://nodals.ai/nodalsbot)

Contact

If you have questions or need to block NodalsBot, please contact us at info@nodals.ai