To add new agents for the Robots Generator click the New Agent button, and enter the following data:
Agent Name: Enter a name (e.g. Google) to recognize the entry later. You may choose any name.
Agent Identifier: Enter the clear name of the agent (e.g. googlebot) to be added. You can find popular agents on the Internet or in the Log files of your web server.
Purpose: Enter the purpose of the agent (e.g. indexing) to be added.
Description: Enter a description (e.g. Agent from Google.com) for better recognition of the entry later.