info:sid/localhost:CollectionHarvester2:Harvester2Faq info:sid/localhost:CollectionHarvester2 CollectionHarvester2 http://alcme.oclc.org:80/wikid/search/WikiDb.localhost Harvester2Faq display OAI Harvester2 Documentation http://www.oclc.org/research/software/oai/harvester2.htm userAssigned mailto:jyoung@oclc.org no info:sid/localhost:CollectionSimpleSchemas:wiki info:sid/localhost:CollectionExternalSchemas:xhtml info:sid/localhost:CollectionExternalSchemas:xhtml 1.1 1 1xwimq 300 http://www.oclc.org/schemas/WikiRepository xml http://alcme.oclc.org:80/wikid/docs/WikiRepository info:sid/localhost:CollectionHarvester2:Harvester2Faq anonymous CollectionHarvester2 2006/07/10/11 inf_3asid_2flocalhost_3aCollectionHarvester2_3aHarvester2Faq_5f20060710112555331 text/xml CollectionHarvester2:Harvester2Faq 2006-07-10 2006-07-10 1 1.1 repos.hasDate = "hasdate" and oai.identifier exact "info:sid/localhost:CollectionHarvester2:Harvester2Faq" cql.any = huh? 1 1 xml default 2006-07-10 http://alcme.oclc.org:80/wikid/docs/WikiRepository/2006/07/10/11/inf_3asid_2flocalhost_3aCollectionHarvester2_3aHarvester2Faq_5f20060710112555331 = OAI Harvester2 FAQ = == Does Harvester2 do ...? == Probably not. Harvester2 is a bare-bones OAI tool you can use to incrementally harvest data from an OAI repository and write it out to disk files. What happens to it from there is left as an exercise for the user. == Which version of OAI-PMH does Harvester2 support? == * OAI-PMH v1.1 * OAI-PMH v2.0 == Does Harvester2 support XOAI-PMH? == I don't know much about XOAI-PMH. From what I can tell, some of the features of XOAI-PMH were integrated into OAI-PMH v2.0. Beyond that, I can't find much in the way of details. == Can Harvester2 process records as they are being harvested? == The first harvester I wrote, (http://www.oclc.org/research/software/oai/harvester.htm''''''), included a hook to allow records to be processed as they were being harvested. The benefit of doing so is nil, though, so I didn't include it in Harvester2. It's better to write the data out to disk first and then run a separate process to do something with it. Since the possibilities beyond this point are infinite, there's not much I could provide in the way of utilities anyway. == How do I use the RawWrite application? == * java -classpath log4j.jar:harvester2.jar:xalan.jar ORG.oclc.oai.harvester2.app.Raw''''''Write {OAI baseURL} * Optional Parameters: ** -out (local filename) ** -from (ISO8601 date) ** -until (ISO 8601 date) ** -metadataPrefix (from the L''''''istMetadataFormats response) ** -resumptionToken (to resume from an interrupted harvest session) ** -setSpec (from the L''''''istSets response) == Which metadata formats does Harvester2 support == Harvester2 can accept any metadataformat available from an OAI repository. Records are just a blob of XML as far as Harvester2 is concerned. == Does Harvester2 support searching? == No. Searching is beyond the scope of OAI-PMH. Once you've harvested some data, doing something useful with it is left as an exercise for the user. Here are some clues to get you started with searching, though: * http://en.wikipedia.org/wiki/OpenSearch * http://en.wikipedia.org/wiki/SRW Note that there are many tools that include OAI harvesting as one of their features. Check out the list at http://www.openarchives.org/tools/tools.html''''''. == Does Harvester2 support I18N? == Harvester2 fully conforms to the OAI-PMH requirement for handling Unicode. == What kind of database does Harvester2 include? == Harvester2 doesn't include a database. It is designed to write harvested data to disk files. Loading this data into a database where it can be used is left as an exercise for the user. == Do I need Tomcat to run Harvester2? == No. Harvester2 is a Java application. It is strictly client-side with an OAI repository acting as the server-side.

OAI Harvester2 FAQ

Does Harvester2 do ...?

Probably not. Harvester2 is a bare-bones OAI tool you can use to incrementally harvest data from an OAI repository and write it out to disk files. What happens to it from there is left as an exercise for the user.

Which version of OAI-PMH does Harvester2 support?

Does Harvester2 support XOAI-PMH?

I don't know much about XOAI-PMH. From what I can tell, some of the features of XOAI-PMH were integrated into OAI-PMH v2.0. Beyond that, I can't find much in the way of details.

Can Harvester2 process records as they are being harvested?

The first harvester I wrote, (http://www.oclc.org/research/software/oai/harvester.htm), included a hook to allow records to be processed as they were being harvested. The benefit of doing so is nil, though, so I didn't include it in Harvester2. It's better to write the data out to disk first and then run a separate process to do something with it. Since the possibilities beyond this point are infinite, there's not much I could provide in the way of utilities anyway.

How do I use the RawWrite application?

Which metadata formats does Harvester2 support

Harvester2 can accept any metadataformat available from an OAI repository. Records are just a blob of XML as far as Harvester2 is concerned.

Does Harvester2 support searching?

No. Searching is beyond the scope of OAI-PMH. Once you've harvested some data, doing something useful with it is left as an exercise for the user. Here are some clues to get you started with searching, though: Note that there are many tools that include OAI harvesting as one of their features. Check out the list at http://www.openarchives.org/tools/tools.html.

Does Harvester2 support I18N?

Harvester2 fully conforms to the OAI-PMH requirement for handling Unicode.

What kind of database does Harvester2 include?

Harvester2 doesn't include a database. It is designed to write harvested data to disk files. Loading this data into a database where it can be used is left as an exercise for the user.

Do I need Tomcat to run Harvester2?

No. Harvester2 is a Java application. It is strictly client-side with an OAI repository acting as the server-side.