Uploaded image for project: 'Pegasus'
  1. Pegasus
  2. PM-1592 Consistent UTF8 environment across full workflow
  3. PM-1593

properties file should be read and written by planner at UTF-8

XMLWordPrintable

    • Type: Icon: Sub-task Sub-task
    • Resolution: Fixed
    • Priority: Icon: Major Major
    • None
    • Affects Version/s: None
    • Component/s: None
    • None

      related issue is what do with the properties file generated in the submit directory.
      file pegasus.1798660981747839618.properties
      pegasus.1798660981747839618.properties: ASCII text

      If we set the LANG. java code (pegasus-rc-client) works fine
      2020.05.22 10:22:50.960 PDT: [DEBUG] [Replica Factory] Connect properties detected

      {db.url=jdbc:sqlite:/scitech/home/bamboo/001-black-di amond-vanilla-condor-5.0API/work/black-diamond-5.0api-1590163925/blÅckƊiamond㒀㑖-0.replicas.db, db.driver=sqlite}


      2020.05.22 10:22:50.964 PDT: [DEBUG] [Replica Factory] Connect properties detected for implementor JDBCRC ->

      {db.url=jdbc:sqlite:/scitech/home/bamboo/001-black-diamond-vanilla-condor-5.0API/work/black-diamond-5.0api-1590163925/blÅckƊiamond㒀㑖-0.replicas.db, properties.file=/scitech/home/bamboo/001-black-diamond-vanilla-condor-5.0API/work/black-diamond-5.0api-1590163925/pegasus.1798660981747839618.properties, db.driver=sqlite}

      however, python code (pegasus-db-admin) is still confused
      2020-05-22 10:22:51,598:DEBUG:Pegasus.tools.properties(245): processing properties file /scitech/home/bamboo/001-black-diamond-vanilla-condor-5.0API/work/black-diamond-5.0api-1590163925/pegasus.1798660981747839618.properties...
      2020.05.22 10:22:51.604 PDT: 2020-05-22 10:22:51,598:DEBUG:Pegasus.tools.properties(145): # parsing properties in <_io.TextIOWrapper name='/scitech/home/bamboo/001-black-diamond-vanilla-condor-5.0API/work/black-diamond-5.0api-1590163925/pegasus.1798660981747839618.propert
      ies' mode='r' encoding='UTF-8'>...

      2020.05.22 10:22:51.698 PDT: 2020-05-22 10:22:51,599:DEBUG:Pegasus.tools.properties(184): #Property being stored is # pegasus.catalog.replica.db.url ==> jdbc:sqlite:/scitech/home/bamboo/001-black-diamond-vanilla-condor-5.0API/work/black-diamond-5.0api-1590163925/blu00C5cku018Aiamondu3480u3456-0.replicas.db

      As a result pegasus-db-admin still fails.
      So I guess need to force java properties to be UTF-8 also

            Assignee:
            vahi Karan Vahi
            Reporter:
            vahi Karan Vahi
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: