[gin-data] Update Ftp transfers
Stuart Martin
smartin at mcs.anl.gov
Mon Aug 28 11:01:25 CDT 2006
FYI:
The updating of the GIN VO membership to TG's gridmap file on tg-
grid1.us.teragrid.org is done periodically by hand.
Sunday afternoon I took the latest contents of http://
kuiken.nikhef.nl/gin.ggf.org/grid-mapfile.
Just now, the gridmap file on tg-grid1.uc-teragrid.org has just been
updated with the GIN VO membership list as it was on Sunday afternoon.
-Stu
On Aug 23, 2006, at Aug 23, 2:30 PM, Gregor von Laszewski wrote:
>
> On Aug 23, 2006, at 11:06 AM, Oxana Smirnova wrote:
>
>> Hi,
>>
>> interesting tables; what surprises me is that almost all the GIN
>> site tests failed, which is rather odd. I must say that our site
>> (hathi.hep.lu.se) was not even aware of tests going on, but it
>> should not have been a problem as long as the tester was a member
>> of the GIN VO and the tests involved simple gridftp transfers.
>
> As explained in my previous mail the reason for the failures were
> related to authentication. I would therefore conclude that
> something went wrong during the process of getting into the VO
> (hategan and kettimuthu). Hence, I do suggest that the process of
> getting into the VO be reevaluated by someone outside of our group
> just to make sure that there is no bug in the process.
>
>>
>> For us to be able to debug this, could you please provide more
>> details, e.g.:
>>
>> 1. Who was actually running the tests (name, or certificate SN)?
> http://kuiken.nikhef.nl/gin.ggf.org/grid-mapfile
>
> "/DC=org/DC=doegrids/OU=People/CN=Mihael Hategan 336881"
> "/DC=org/DC=doegrids/OU=People/CN=Rajkumar Kettimuthu 227852"
>
>> 2. Do these tests expect some particular utilities/tools to be up
>> on the storage servers, except of the gridftp server itself?
> no
>> 3. What exactly is meant by "transfer from A to B" in this matrix?
>> A 3d party transfer initiated by a client at C?
> yes.
>> 4. If these are 3d party transfers, why would a transfer B -> A be
>> different from that of A -> B?
> I thought this would be a normal behavior. If I am mistaken on
> this, please let me know.
>> 5. If the transfers are not 3rd party but are initialized by a
>> user process on the storage element, how do you launch the process?
> see below
>>
>> FWIW, our SEs normally do not support interactive logins (except
>> for the console admin session), and do not run other services
>> except of gridftp for data transfer and ldap for bookkeeping.
>>
> Do you have some documentation on how this system is configured. I
> was under the impression that if I know the gridftp server and the
> address I should just be able to start communication with it. That
> is essentially what we tested on TG where it seems to work.
>
> I assume once the VO accounting issues are solved I am almost
> certain we can just replicate the experiment. Is there any
> volunteer that has these accounts already?
>
>> Thanks,
>> Oxana
>>
>> Gregor von Laszewski пишет:
>>> Hi:
>>> please find included two tables. First one from TeraGrid to
>>> show that the transfer tests were successful (Raj) FOR TG. We
>>> have explicitly made sure that the program on the TG is run by
>>> someone outside our group as to verify that it works and can be
>>> easily installed. Thanks Raj!
>>> The second file is form the Gin testbed that shows we have
>>> problems with the accounts. E.g. The errors we get are all
>>> related to authentication errors (hategan). This test was
>>> conducted by Mike H. Maybe it would be a good lesson if we we ask
>>> someone that has working accounts to run that program? Maybe that
>>> would speed things up.
>>> The lesson that we learned from this is that it actually seems
>>> not difficult to run the program, however making sure that the
>>> authentication works may not be as straight forward as we
>>> originally thought. Maybe we can test the GIN account management
>>> with another user, just to make sure that the process is
>>> completely worked out. So far it looks like that two of our users
>>> had difficulties completing the account application process. I am
>>> not sure what the cause for this is. Double checking probably
>>> does not hurt.
>>> Gregor
>>> .
>>> --------------------------------------------------------------------
>>> ----
>>> Source\Destination gridftp-hg.
>>> ncsa.
>>> teragrid.
>>> org tg-viz-gridftp.
>>> tacc.
>>> teragrid.
>>> org tg-gridftp.
>>> lonestar.
>>> tacc.
>>> teragrid.
>>> org tg-gridftp.
>>> ornl.
>>> teragrid.
>>> org tg-gridftp.
>>> psc.
>>> teragrid.
>>> org tg-data.
>>> purdue.
>>> teragrid.
>>> org tg-gridftp.
>>> sdsc.
>>> teragrid.
>>> org tg-gridftp.
>>> uc.
>>> teragrid.
>>> org
>>> gridftp-hg.ncsa.teragrid.org - Passed
>>> 13035 ms
>>> 2.455 MB/s
>>> Passed
>>> 3872 ms
>>> 8.264 MB/s
>>> Passed
>>> 33298 ms
>>> 0.961 MB/s
>>> Passed
>>> 5655 ms
>>> 5.659 MB/s
>>> Passed
>>> 7035 ms
>>> 4.549 MB/s
>>> Passed
>>> 42572 ms
>>> 0.752 MB/s
>>> Passed
>>> 11394 ms
>>> 2.808 MB/s
>>> tg-viz-gridftp.tacc.teragrid.org Passed
>>> 16406 ms
>>> 1.951 MB/s
>>> - Passed
>>> 7800 ms
>>> 4.103 MB/s
>>> Passed
>>> 38484 ms
>>> 0.832 MB/s
>>> Passed
>>> 8498 ms
>>> 3.766 MB/s
>>> Passed
>>> 23538 ms
>>> 1.36 MB/s
>>> Passed
>>> 63106 ms
>>> 0.507 MB/s
>>> Passed
>>> 37709 ms
>>> 0.849 MB/s
>>> tg-gridftp.lonestar.tacc.teragrid.org Passed
>>> 12137 ms
>>> 2.637 MB/s
>>> Passed
>>> 7441 ms
>>> 4.3 MB/s
>>> - Passed
>>> 33625 ms
>>> 0.952 MB/s
>>> Passed
>>> 4267 ms
>>> 7.499 MB/s
>>> Passed
>>> 17463 ms
>>> 1.832 MB/s
>>> Passed
>>> 56463 ms
>>> 0.567 MB/s
>>> Passed
>>> 32292 ms
>>> 0.991 MB/s
>>> tg-gridftp.ornl.teragrid.org Passed
>>> 41469 ms
>>> 0.772 MB/s
>>> Passed
>>> 40915 ms
>>> 0.782 MB/s
>>> Passed
>>> 33679 ms
>>> 0.95 MB/s
>>> - Passed
>>> 33465 ms
>>> 0.956 MB/s
>>> Passed
>>> 46567 ms
>>> 0.687 MB/s
>>> Passed
>>> 85475 ms
>>> 0.374 MB/s
>>> Passed
>>> 56081 ms
>>> 0.571 MB/s
>>> tg-gridftp.psc.teragrid.org Passed
>>> 7885 ms
>>> 4.058 MB/s
>>> Passed
>>> 10769 ms
>>> 2.971 MB/s
>>> Passed
>>> 3964 ms
>>> 8.073 MB/s
>>> Passed
>>> 33294 ms
>>> 0.961 MB/s
>>> - Passed
>>> 11257 ms
>>> 2.843 MB/s
>>> Passed
>>> 48501 ms
>>> 0.66 MB/s
>>> Passed
>>> 20450 ms
>>> 1.565 MB/s
>>> tg-data.purdue.teragrid.org Passed
>>> 6481 ms
>>> 4.938 MB/s
>>> Passed
>>> 15624 ms
>>> 2.048 MB/s
>>> Passed
>>> 11621 ms
>>> 2.754 MB/s
>>> Passed
>>> 41827 ms
>>> 0.765 MB/s
>>> Passed
>>> 7418 ms
>>> 4.314 MB/s
>>> - Passed
>>> 43799 ms
>>> 0.731 MB/s
>>> Passed
>>> 8459 ms
>>> 3.783 MB/s
>>> tg-gridftp.sdsc.teragrid.org Passed
>>> 23558 ms
>>> 1.358 MB/s
>>> Passed
>>> 15213 ms
>>> 2.103 MB/s
>>> Passed
>>> 5788 ms
>>> 5.529 MB/s
>>> Passed
>>> 34958 ms
>>> 0.915 MB/s
>>> Passed
>>> 5076 ms
>>> 6.304 MB/s
>>> Passed
>>> 33675 ms
>>> 0.95 MB/s
>>> - Passed
>>> 58628 ms
>>> 0.546 MB/s
>>> tg-gridftp.uc.teragrid.org Passed
>>> 9208 ms
>>> 3.475 MB/s
>>> Passed
>>> 13735 ms
>>> 2.33 MB/s
>>> Passed
>>> 8124 ms
>>> 3.939 MB/s
>>> Passed
>>> 37535 ms
>>> 0.853 MB/s
>>> Passed
>>> 7624 ms
>>> 4.197 MB/s
>>> Passed
>>> 5326 ms
>>> 6.008 MB/s
>>> Passed
>>> 45094 ms
>>> 0.71 MB/s
>>> -
>>> --------------------------------------------------------------------
>>> ----
>>> Source\Destination gridftp-hg.
>>> ncsa.
>>> teragrid.
>>> org tg-gridftp.
>>> psc.
>>> teragrid.
>>> org tg-gridftp.
>>> bigben.
>>> psc.
>>> teragrid.
>>> org tg-gridftp.
>>> purdue.
>>> teragrid.
>>> org tg-gridftp.
>>> sdsc.
>>> teragrid.
>>> org tg-gridftp.
>>> uc.
>>> teragrid.
>>> org sedsk00.
>>> hep.
>>> ph.
>>> ic.
>>> ac.
>>> uk osg-gw-2.
>>> t2.
>>> ucsd.
>>> edu hathi.
>>> hep.
>>> lu.
>>> se grid-data.
>>> man.
>>> ac.
>>> uk
>>> gridftp-hg.ncsa.teragrid.org - Failed <error1155684133670.html>
>>> Failed <error1155684133671.html> Failed <error1155684133672.html>
>>> Failed <error1155684133673.html> Passed
>>> 34654 ms
>>> 7.387 MB/s
>>> Failed <error1155684133674.html> Passed
>>> 16506 ms
>>> 15.51 MB/s
>>> Failed <error1155684133675.html> Failed <error1155684133676.html>
>>> tg-gridftp.psc.teragrid.org Failed <error1155684133677.html> -
>>> Failed <error1155684133678.html> Failed <error1155684133679.html>
>>> Failed <error1155684133680.html> Failed <error1155684133681.html>
>>> Failed <error1155684133682.html> Failed <error1155684133683.html>
>>> Failed <error1155684133684.html> Failed <error1155684133685.html>
>>> tg-gridftp.bigben.psc.teragrid.org Failed
>>> <error1155684133686.html> Failed <error1155684133687.html> -
>>> Failed <error1155684133688.html> Failed <error1155684133689.html>
>>> Failed <error1155684133690.html> Failed <error1155684133691.html>
>>> Failed <error1155684133692.html> Failed <error1155684133693.html>
>>> Failed <error1155684133694.html>
>>> tg-gridftp.purdue.teragrid.org Failed <error1155684133695.html>
>>> Failed <error1155684133696.html> Failed
>>> <error1155684133697.html> - Failed <error1155684133698.html>
>>> Failed <error1155684133699.html> Failed <error1155684133700.html>
>>> Failed <error1155684133701.html> Failed <error1155684133702.html>
>>> Failed <error1155684133703.html>
>>> tg-gridftp.sdsc.teragrid.org Failed <error1155684133704.html>
>>> Failed <error1155684133705.html> Failed <error1155684133706.html>
>>> Failed <error1155684133707.html> - Failed
>>> <error1155684133708.html> Failed <error1155684133709.html> Failed
>>> <error1155684133710.html> Failed <error1155684133711.html> Failed
>>> <error1155684133712.html>
>>> tg-gridftp.uc.teragrid.org Passed
>>> 15420 ms
>>> 16.602 MB/s
>>> Failed <error1155684133713.html> Failed
>>> <error1155684133714.html> Failed <error1155684133715.html> Failed
>>> <error1155684133716.html> - Failed <error1155684133717.html> Passed
>>> 15828 ms
>>> 16.174 MB/s
>>> Failed <error1155684133718.html> Failed <error1155684133719.html>
>>> sedsk00.hep.ph.ic.ac.uk Failed <error1155684133720.html> Failed
>>> <error1155684133721.html> Failed <error1155684133722.html> Failed
>>> <error1155684133723.html> Failed <error1155684133724.html> Failed
>>> <error1155684133725.html> - Failed <error1155684133726.html>
>>> Failed <error1155684133727.html> Failed <error1155684133728.html>
>>> osg-gw-2.t2.ucsd.edu Timed-out Failed <error1155684133730.html>
>>> Failed <error1155684133731.html> Failed <error1155684133732.html>
>>> Failed <error1155684133733.html> Timed-out Timed-out - Failed
>>> <error1155684133736.html> Failed <error1155684133737.html>
>>> hathi.hep.lu.se Failed <error1155684133738.html> Failed
>>> <error1155684133739.html> Failed <error1155684133740.html> Failed
>>> <error1155684133741.html> Failed <error1155684133742.html> Failed
>>> <error1155684133743.html> Failed <error1155684133744.html> Failed
>>> <error1155684133745.html> - Failed <error1155684133746.html>
>>> grid-data.man.ac.uk Failed <error1155684133747.html> Failed
>>> <error1155684133748.html> Failed <error1155684133749.html> Failed
>>> <error1155684133750.html> Failed <error1155684133751.html> Failed
>>> <error1155684133752.html> Failed <error1155684133753.html> Failed
>>> <error1155684133754.html> Failed <error1155684133755.html> -
>>
>
More information about the gin-data
mailing list