[gin-data] Update Ftp transfers

Gregor von Laszewski gregor at mcs.anl.gov
Wed Aug 23 14:30:32 CDT 2006 

On Aug 23, 2006, at 11:06 AM, Oxana Smirnova wrote:

> Hi,
>
> interesting tables; what surprises me is that almost all the GIN  
> site tests failed, which is rather odd. I must say that our site  
> (hathi.hep.lu.se) was not even aware of tests going on, but it  
> should not have been a problem as long as the tester was a member  
> of the GIN VO and the tests involved simple gridftp transfers.

As explained in my previous mail the reason for the failures were  
related to authentication. I would therefore conclude that something  
went wrong during the process of getting into the VO (hategan and  
kettimuthu). Hence, I do suggest that the process of getting into the  
VO be reevaluated by someone outside of our group just to make sure  
that there is no bug in the process.

>
> For us to be able to debug this, could you please provide more  
> details, e.g.:
>
> 1. Who was actually running the tests (name, or certificate SN)?
http://kuiken.nikhef.nl/gin.ggf.org/grid-mapfile

"/DC=org/DC=doegrids/OU=People/CN=Mihael Hategan 336881"
"/DC=org/DC=doegrids/OU=People/CN=Rajkumar Kettimuthu 227852"

> 2. Do these tests expect some particular utilities/tools to be up  
> on the storage servers, except of the gridftp server itself?
no
> 3. What exactly is meant by "transfer from A to B" in this matrix?  
> A 3d party transfer initiated by a client at C?
yes.
> 4. If these are 3d party transfers, why would a transfer B -> A be  
> different from that of A -> B?
I thought this would be a normal behavior. If I am mistaken on this,  
please let me know.
> 5. If the transfers are not 3rd party but are initialized by a user  
> process on the storage element, how do you launch the process?
see below
>
> FWIW, our SEs normally do not support interactive logins (except  
> for the console admin session), and do not run other services  
> except of gridftp for data transfer and ldap for bookkeeping.
>
Do you have some documentation on how this system is configured. I  
was under the impression that if I know the gridftp server and the  
address I should just be able to start communication with it. That is  
essentially what we tested on TG where it seems to work.

I assume once the VO accounting issues are solved I am almost certain  
we can just replicate the experiment. Is there any volunteer that has  
these accounts already?

> Thanks,
> Oxana
>
> Gregor von Laszewski пишет:
>> Hi:
>>     please find included two tables. First one from TeraGrid to  
>> show that the transfer tests were successful (Raj) FOR TG. We have  
>> explicitly made sure that the program on the TG is run by someone  
>> outside our group as to verify that it works and can be easily  
>> installed. Thanks Raj!
>> The second file is form the Gin testbed that shows we have  
>> problems with the accounts. E.g. The errors we get are all related  
>> to authentication errors (hategan). This test was conducted by  
>> Mike H. Maybe it would be a good lesson if we we ask someone that  
>> has working accounts to run that program? Maybe that would speed  
>> things up.
>> The lesson that we learned from this is that it actually seems not  
>> difficult to run the program, however making sure that the  
>> authentication works may not be as straight forward as we  
>> originally thought. Maybe we can test the  GIN account management  
>> with another user, just to make sure that the process is  
>> completely worked out. So far it looks like that two of our users  
>> had difficulties completing the account application process. I am  
>> not sure what the cause for this is. Double checking probably does  
>> not hurt.
>> Gregor
>> .
>> --------------------------------------------------------------------- 
>> ---
>> Source\Destination	gridftp-hg.
>> ncsa.
>> teragrid.
>> org	tg-viz-gridftp.
>> tacc.
>> teragrid.
>> org	tg-gridftp.
>> lonestar.
>> tacc.
>> teragrid.
>> org	tg-gridftp.
>> ornl.
>> teragrid.
>> org	tg-gridftp.
>> psc.
>> teragrid.
>> org	tg-data.
>> purdue.
>> teragrid.
>> org	tg-gridftp.
>> sdsc.
>> teragrid.
>> org	tg-gridftp.
>> uc.
>> teragrid.
>> org
>> gridftp-hg.ncsa.teragrid.org	-	Passed
>> 13035 ms
>> 2.455 MB/s
>> 	Passed
>> 3872 ms
>> 8.264 MB/s
>> 	Passed
>> 33298 ms
>> 0.961 MB/s
>> 	Passed
>> 5655 ms
>> 5.659 MB/s
>> 	Passed
>> 7035 ms
>> 4.549 MB/s
>> 	Passed
>> 42572 ms
>> 0.752 MB/s
>> 	Passed
>> 11394 ms
>> 2.808 MB/s
>> tg-viz-gridftp.tacc.teragrid.org	Passed
>> 16406 ms
>> 1.951 MB/s
>> 	-	Passed
>> 7800 ms
>> 4.103 MB/s
>> 	Passed
>> 38484 ms
>> 0.832 MB/s
>> 	Passed
>> 8498 ms
>> 3.766 MB/s
>> 	Passed
>> 23538 ms
>> 1.36 MB/s
>> 	Passed
>> 63106 ms
>> 0.507 MB/s
>> 	Passed
>> 37709 ms
>> 0.849 MB/s
>> tg-gridftp.lonestar.tacc.teragrid.org	Passed
>> 12137 ms
>> 2.637 MB/s
>> 	Passed
>> 7441 ms
>> 4.3 MB/s
>> 	-	Passed
>> 33625 ms
>> 0.952 MB/s
>> 	Passed
>> 4267 ms
>> 7.499 MB/s
>> 	Passed
>> 17463 ms
>> 1.832 MB/s
>> 	Passed
>> 56463 ms
>> 0.567 MB/s
>> 	Passed
>> 32292 ms
>> 0.991 MB/s
>> tg-gridftp.ornl.teragrid.org	Passed
>> 41469 ms
>> 0.772 MB/s
>> 	Passed
>> 40915 ms
>> 0.782 MB/s
>> 	Passed
>> 33679 ms
>> 0.95 MB/s
>> 	-	Passed
>> 33465 ms
>> 0.956 MB/s
>> 	Passed
>> 46567 ms
>> 0.687 MB/s
>> 	Passed
>> 85475 ms
>> 0.374 MB/s
>> 	Passed
>> 56081 ms
>> 0.571 MB/s
>> tg-gridftp.psc.teragrid.org	Passed
>> 7885 ms
>> 4.058 MB/s
>> 	Passed
>> 10769 ms
>> 2.971 MB/s
>> 	Passed
>> 3964 ms
>> 8.073 MB/s
>> 	Passed
>> 33294 ms
>> 0.961 MB/s
>> 	-	Passed
>> 11257 ms
>> 2.843 MB/s
>> 	Passed
>> 48501 ms
>> 0.66 MB/s
>> 	Passed
>> 20450 ms
>> 1.565 MB/s
>> tg-data.purdue.teragrid.org	Passed
>> 6481 ms
>> 4.938 MB/s
>> 	Passed
>> 15624 ms
>> 2.048 MB/s
>> 	Passed
>> 11621 ms
>> 2.754 MB/s
>> 	Passed
>> 41827 ms
>> 0.765 MB/s
>> 	Passed
>> 7418 ms
>> 4.314 MB/s
>> 	-	Passed
>> 43799 ms
>> 0.731 MB/s
>> 	Passed
>> 8459 ms
>> 3.783 MB/s
>> tg-gridftp.sdsc.teragrid.org	Passed
>> 23558 ms
>> 1.358 MB/s
>> 	Passed
>> 15213 ms
>> 2.103 MB/s
>> 	Passed
>> 5788 ms
>> 5.529 MB/s
>> 	Passed
>> 34958 ms
>> 0.915 MB/s
>> 	Passed
>> 5076 ms
>> 6.304 MB/s
>> 	Passed
>> 33675 ms
>> 0.95 MB/s
>> 	-	Passed
>> 58628 ms
>> 0.546 MB/s
>> tg-gridftp.uc.teragrid.org	Passed
>> 9208 ms
>> 3.475 MB/s
>> 	Passed
>> 13735 ms
>> 2.33 MB/s
>> 	Passed
>> 8124 ms
>> 3.939 MB/s
>> 	Passed
>> 37535 ms
>> 0.853 MB/s
>> 	Passed
>> 7624 ms
>> 4.197 MB/s
>> 	Passed
>> 5326 ms
>> 6.008 MB/s
>> 	Passed
>> 45094 ms
>> 0.71 MB/s
>> 	-
>> --------------------------------------------------------------------- 
>> ---
>> Source\Destination	gridftp-hg.
>> ncsa.
>> teragrid.
>> org	tg-gridftp.
>> psc.
>> teragrid.
>> org	tg-gridftp.
>> bigben.
>> psc.
>> teragrid.
>> org	tg-gridftp.
>> purdue.
>> teragrid.
>> org	tg-gridftp.
>> sdsc.
>> teragrid.
>> org	tg-gridftp.
>> uc.
>> teragrid.
>> org	sedsk00.
>> hep.
>> ph.
>> ic.
>> ac.
>> uk	osg-gw-2.
>> t2.
>> ucsd.
>> edu	hathi.
>> hep.
>> lu.
>> se	grid-data.
>> man.
>> ac.
>> uk
>> gridftp-hg.ncsa.teragrid.org	-	Failed <error1155684133670.html>	 
>> Failed <error1155684133671.html>	Failed <error1155684133672.html>	 
>> Failed <error1155684133673.html>	Passed
>> 34654 ms
>> 7.387 MB/s
>> 	Failed <error1155684133674.html>	Passed
>> 16506 ms
>> 15.51 MB/s
>> 	Failed <error1155684133675.html>	Failed <error1155684133676.html>
>> tg-gridftp.psc.teragrid.org	Failed <error1155684133677.html>	-	 
>> Failed <error1155684133678.html>	Failed <error1155684133679.html>	 
>> Failed <error1155684133680.html>	Failed <error1155684133681.html>	 
>> Failed <error1155684133682.html>	Failed <error1155684133683.html>	 
>> Failed <error1155684133684.html>	Failed <error1155684133685.html>
>> tg-gridftp.bigben.psc.teragrid.org	Failed  
>> <error1155684133686.html> Failed <error1155684133687.html>	-	 
>> Failed <error1155684133688.html> Failed <error1155684133689.html>	 
>> Failed <error1155684133690.html>	Failed <error1155684133691.html>	 
>> Failed <error1155684133692.html>	Failed <error1155684133693.html>	 
>> Failed <error1155684133694.html>
>> tg-gridftp.purdue.teragrid.org	Failed <error1155684133695.html>	 
>> Failed <error1155684133696.html>	Failed  
>> <error1155684133697.html>	-	Failed <error1155684133698.html>	 
>> Failed <error1155684133699.html>	Failed <error1155684133700.html>	 
>> Failed <error1155684133701.html>	Failed <error1155684133702.html>	 
>> Failed <error1155684133703.html>
>> tg-gridftp.sdsc.teragrid.org	Failed <error1155684133704.html>	 
>> Failed <error1155684133705.html>	Failed <error1155684133706.html>	 
>> Failed <error1155684133707.html>	-	Failed  
>> <error1155684133708.html>	Failed <error1155684133709.html>	Failed  
>> <error1155684133710.html>	Failed <error1155684133711.html>	Failed  
>> <error1155684133712.html>
>> tg-gridftp.uc.teragrid.org	Passed
>> 15420 ms
>> 16.602 MB/s
>> 	Failed <error1155684133713.html>	Failed <error1155684133714.html>  
>> Failed <error1155684133715.html>	Failed  
>> <error1155684133716.html>	- Failed <error1155684133717.html>	Passed
>> 15828 ms
>> 16.174 MB/s
>> 	Failed <error1155684133718.html>	Failed <error1155684133719.html>
>> sedsk00.hep.ph.ic.ac.uk	Failed <error1155684133720.html>	Failed  
>> <error1155684133721.html>	Failed <error1155684133722.html>	Failed  
>> <error1155684133723.html>	Failed <error1155684133724.html>	Failed  
>> <error1155684133725.html>	-	Failed <error1155684133726.html>	 
>> Failed <error1155684133727.html>	Failed <error1155684133728.html>
>> osg-gw-2.t2.ucsd.edu	Timed-out	Failed <error1155684133730.html>	 
>> Failed <error1155684133731.html>	Failed <error1155684133732.html>	 
>> Failed <error1155684133733.html>	Timed-out	Timed-out	-	Failed  
>> <error1155684133736.html>	Failed <error1155684133737.html>
>> hathi.hep.lu.se	Failed <error1155684133738.html>	Failed  
>> <error1155684133739.html>	Failed <error1155684133740.html>	Failed  
>> <error1155684133741.html>	Failed <error1155684133742.html>	Failed  
>> <error1155684133743.html>	Failed <error1155684133744.html>	Failed  
>> <error1155684133745.html>	-	Failed <error1155684133746.html>
>> grid-data.man.ac.uk	Failed <error1155684133747.html>	Failed  
>> <error1155684133748.html>	Failed <error1155684133749.html>	Failed  
>> <error1155684133750.html>	Failed <error1155684133751.html>	Failed  
>> <error1155684133752.html>	Failed <error1155684133753.html>	Failed  
>> <error1155684133754.html>	Failed <error1155684133755.html>	-
>

More information about the gin-data mailing list