com.google.enterprise.adaptor.experimental

Class StresserAdaptor

java.lang.Object

com.google.enterprise.adaptor.AbstractAdaptor

com.google.enterprise.adaptor.experimental.StresserAdaptor

All Implemented Interfaces:

Adaptor

public class StresserAdaptor
extends AbstractAdaptor

Result of running this adaptor: 1. The depth and number of documents is configured with adaptor.branches 2. The files are at the leaves 3. Default is depth of 10 of CHILD_OVERRIDES 4. There is a "specialUser" who has access to roughly 100 files and will be denied access to all other files. The 100 files are uniformly distributed around all leaves. 5. For all the files/directories other than the 100 files which the special user has access to, 10001 in total will be marked as public. The rest will have 2 random permitted users and 2 unique denied users. The users' names are uniquely made up, e.g., user1, user123. Note that the unique users get changed with every recrawl. 6. crawlOnce is set to true

Constructor Summary

Constructors

Constructor and Description
StresserAdaptor()

Method Summary

Modifier and Type	Method and Description
void	getDocContent(Request req, Response resp) Provides contents and metadata of particular document.
void	getDocIds(DocIdPusher pusher) Pushes all the DocIds that are suppose to be indexed by the GSA.
void	init(AdaptorContext context) Initialize adaptor with the current context.
void	initConfig(Config config) Provides the opportunity for the Adaptor to create new configuration values or override default values.
static void	main(String[] args) Call default main for adaptors.

Methods inherited from class com.google.enterprise.adaptor.AbstractAdaptor

destroy, main

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StresserAdaptor

public StresserAdaptor()

Method Detail

initConfig

public void initConfig(Config config)

Description copied from class: AbstractAdaptor

Provides the opportunity for the Adaptor to create new configuration values or override default values. Only Config.addKey(java.lang.String, java.lang.String) should likely be called. The user's configuration will override any values set in this way. This method is called by AbstractAdaptor.main(com.google.enterprise.adaptor.Adaptor, java.lang.String[]) before Adaptor.init(com.google.enterprise.adaptor.AdaptorContext) is called.

This implementation does nothing.

Specified by:

initConfig in interface Adaptor

Overrides:

initConfig in class AbstractAdaptor

Parameters:

config - to modify with additional keys

init

public void init(AdaptorContext context)
          throws Exception

Description copied from class: AbstractAdaptor

Initialize adaptor with the current context. This is the ideal time to start any threads to do extra behind-the-scenes work. The context points to other useful objects that can be used at any time. For example, methods on DocIdPusher provided via AdaptorContext.getDocIdPusher() are allowed to be called whenever the Adaptor wishes. This allows doing event-based incremental pushes at any time.

The method is called at the end of GsaCommunicationHandler.start(java.lang.Runnable).

If you experience a fatal error during initialization, feel free to throw an Exception to cancel the startup process.

This implementation does nothing.

Specified by:

init in interface Adaptor

Overrides:

init in class AbstractAdaptor

Parameters:

context - for instance includes completed config

Throws:

Exception - if things are not going well

getDocIds

public void getDocIds(DocIdPusher pusher)
               throws InterruptedException

Description copied from interface: Adaptor

Pushes all the DocIds that are suppose to be indexed by the GSA. This will frequently involve re-sending DocIds to the GSA, but this allows healing previous errors and cache inconsistencies. Re-sending DocIds is very fast and should be considered free on the GSA. This method should determine a list of DocIds to push and call DocIdPusher.pushDocIds(java.lang.Iterable<com.google.enterprise.adaptor.DocId>) one or more times and DocIdPusher.pushNamedResources(java.util.Map<com.google.enterprise.adaptor.DocId, com.google.enterprise.adaptor.Acl>) if using named resources.

pusher is provided as convenience and is the same object provided to Adaptor.init(com.google.enterprise.adaptor.AdaptorContext) previously. This method may take a while and implementations are free to call Thread.sleep(long) occasionally to reduce load.

If you experience a fatal error, feel free to throw an IOException or RuntimeException. In the case of an error, the ExceptionHandler in use in AdaptorContext will determine if and when to retry.

Parameters:

pusher - used to send doc ids to GSA

Throws:

InterruptedException - if an IO operations throws it

getDocContent

public void getDocContent(Request req,
                          Response resp)
                   throws IOException

Description copied from interface: Adaptor

Provides contents and metadata of particular document. This method should be highly parallelizable and support twenty or more concurrent calls. Two to three concurrent calls may be average during initial GSA crawling, but twenty or more concurrent calls is typical when the GSA is recrawling unmodified content.

If you experience a fatal error, feel free to throw an IOException or RuntimeException. In the case of an error, the GSA will determine if and when to retry.

Parameters:

req - info about document being sought

resp - place to put document data

Throws:

IOException - if getting data fails

main

public static void main(String[] args)
                 throws Exception

Call default main for adaptors.

Parameters:

args - argv

Throws:

Exception - when something goes wrong