/[volute]/trunk/projects/WebAssets/tools/docrepoToADS/harvest.py
ViewVC logotype

Log of /trunk/projects/WebAssets/tools/docrepoToADS/harvest.py

Parent Directory Parent Directory | Revision Log Revision Log


Links to HEAD: (view) (annotate)
Sticky Revision:

Revision 5328 - (view) (annotate) - [select for diffs]
Modified Thu Mar 14 13:22:27 2019 UTC (22 months ago) by msdemlei
File length: 24260 byte(s)
Diff to previous 5303
docrepoToADS: migrating to requests to mitigate impact of varying to encodings.



Revision 5303 - (view) (annotate) - [select for diffs]
Modified Fri Jan 18 13:00:37 2019 UTC (23 months, 4 weeks ago) by msdemlei
File length: 24362 byte(s)
Diff to previous 5111
Moving docrepoToADS to the ivoa.net tools.



Revision 5111 - (view) (annotate) - [select for diffs]
Modified Wed Aug 22 12:47:17 2018 UTC (2 years, 4 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 24362 byte(s)
Diff to previous 5026
docrepoToADS: no longer caching the index page.



Revision 5026 - (view) (annotate) - [select for diffs]
Modified Wed May 30 20:39:06 2018 UTC (2 years, 7 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 24351 byte(s)
Diff to previous 3754
docrepoToADS: Adding support for Endorsed Notes as refereed publications.



Revision 3754 - (view) (annotate) - [select for diffs]
Modified Fri Dec 2 09:49:54 2016 UTC (4 years, 1 month ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 23686 byte(s)
Diff to previous 3753
Adding limited support for enumerations in abstracts.

New command line option -s to watch formatting of single records 
(for debugging).


Revision 3753 - (view) (annotate) - [select for diffs]
Modified Thu Dec 1 14:31:08 2016 UTC (4 years, 1 month ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 21773 byte(s)
Diff to previous 3688
docrepoToADS: enabled production of records for notes.



Revision 3688 - (view) (annotate) - [select for diffs]
Modified Fri Nov 4 15:24:49 2016 UTC (4 years, 2 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 22080 byte(s)
Diff to previous 3687
docrepoToADS: arXiv mapping parser now has a more useful message.


Revision 3687 - (view) (annotate) - [select for diffs]
Modified Fri Nov 4 15:21:18 2016 UTC (4 years, 2 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 21918 byte(s)
Diff to previous 3240
docrepoToADS: removed fake response.



Revision 3240 - (view) (annotate) - [select for diffs]
Modified Thu Feb 4 15:44:44 2016 UTC (4 years, 11 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 24083 byte(s)
Diff to previous 3156
Updated harvest to use the ADS bigquery interface to not re-upload
existing records.



Revision 3156 - (view) (annotate) - [select for diffs]
Modified Thu Nov 19 14:48:53 2015 UTC (5 years, 1 month ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 21794 byte(s)
Diff to previous 3134
docrepo to ADS: fixed ADS access (but still doesn't work due to API changes).

Also, introduced a hack to un-confuse the parse of author lists containing
Grid *and* Web services.



Revision 3134 - (view) (annotate) - [select for diffs]
Modified Mon Oct 26 06:55:31 2015 UTC (5 years, 2 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 20955 byte(s)
Diff to previous 3133
docrepoToADS: disambiguation work, adsrec-per-version should be fine.



Revision 3133 - (view) (annotate) - [select for diffs]
Modified Mon Oct 26 03:46:05 2015 UTC (5 years, 2 months ago) by msdemlei
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 19601 byte(s)
Diff to previous 2840
docrepoToADS: Updates to put arXiv ids in.

In particular, the docrepo-to-arXiv mapping now goes from short name to
arXiv id.


Revision 2840 - (view) (annotate) - [select for diffs]
Modified Wed Jan 28 15:34:52 2015 UTC (5 years, 11 months ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 17602 byte(s)
Diff to previous 2836
docrepo to ADS: Added validation for unique bibcodes.


Revision 2836 - (view) (annotate) - [select for diffs]
Modified Tue Jan 27 12:20:46 2015 UTC (5 years, 11 months ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 16814 byte(s)
Diff to previous 2835
docrepo to ADS: made bibcode a property of Document.



Revision 2835 - (view) (annotate) - [select for diffs]
Modified Tue Jan 27 12:19:05 2015 UTC (5 years, 11 months ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 16843 byte(s)
Diff to previous 2834
docrepo to ADS: preliminary support for filtering out records present in ADS.


Revision 2834 - (view) (annotate) - [select for diffs]
Modified Tue Jan 27 11:50:14 2015 UTC (5 years, 11 months ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 15966 byte(s)
Diff to previous 2811
docrepoToADS: refactored to use classes for Docs and the Collection.

Also introduced initials guessing, simple doctests.



Revision 2811 - (view) (annotate) - [select for diffs]
Modified Fri Jan 16 08:58:09 2015 UTC (6 years ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 9818 byte(s)
Diff to previous 2810
docrepo to ADS: swapped order of month and day in the bibcode.



Revision 2810 - (view) (annotate) - [select for diffs]
Modified Wed Jan 14 12:02:32 2015 UTC (6 years ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 9818 byte(s)
Diff to previous 2809
docrepo to ADS: Fixed date parsing.



Revision 2809 - (view) (annotate) - [select for diffs]
Modified Wed Jan 14 10:47:50 2015 UTC (6 years ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 9819 byte(s)
Diff to previous 2808
docrepo to ADS: editors are now prepended to the author lists.



Revision 2808 - (view) (annotate) - [select for diffs]
Modified Wed Jan 14 10:29:00 2015 UTC (6 years ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 8823 byte(s)
Diff to previous 2749
docrepo to ADS: Added identifier generation.



Revision 2749 - (view) (annotate) - [select for diffs]
Added Thu Oct 16 15:53:30 2014 UTC (6 years, 3 months ago) by volute@g-vo.org
Original Path: trunk/projects/ivoapub/docrepoToADS/harvest.py
File length: 6475 byte(s)
Adding docrepo harvesting script for producing ADS records.

This is a working prototype as yet but should *not* be used to produce
actual ADS records as details need to be clarified in Docstd and Exec.



This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, enter a numeric revision.

  Diffs between and
  Type of Diff should be a

msdemlei@ari.uni-heidelberg.de
ViewVC Help
Powered by ViewVC 1.1.26