Difference between revisions of "Config:DataSource"

From SUMOwiki
Jump to navigationJump to search
(Undo revision 3924 by Tdhaene (Talk))
Line 1: Line 1:
 +
'''Generated for SUMO toolbox version 6'''.
 +
''We are well aware that the list below is incomplete and possibly even out of date in some cases.  We try to document everything as best we can but much is limited by available time and manpower.  The most up to date documentation can always be found (if not here) in the default.xml configuration file and, of course, in the source files.''
 
== SampleEvaluator ==
 
== SampleEvaluator ==
  
Line 20: Line 22:
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</source>
 
</source>
 
 
=== matlab ===
 
=== matlab ===
 
Evaluate samples using a matlab script (ie. your simulator is a matlab script)
 
Evaluate samples using a matlab script (ie. your simulator is a matlab script)
Line 32: Line 33:
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</source>
 
</source>
=== matlabClass ===
+
=== griddedDataset ===
Evaluate samples using a matlab class
 
<source xmlns:saxon="http://icl.com/saxon" lang="xml">
 
<[[Config:SampleEvaluator|SampleEvaluator]] id="matlabClass" type="ibbt.sumo.SampleEvaluators.matlab.MatlabClassSampleEvaluator">
 
  <!-- Maximum number of times to resubmit a point (e.g., in case something went wrong) -->
 
  <Option key="maxResubmissions" value="1"/>
 
  <!-- If a sample takes longer than "sampleTimeout*average evaluation time of one sample"
 
        seconds to evaluate it is removed from the pending list (set to -1 to disable) -->
 
  <Option key="sampleTimeout" value="-1"/>
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</source>
 
=== gridded ===
 
 
Evaluate samples using a gridded dataset
 
Evaluate samples using a gridded dataset
 
<source xmlns:saxon="http://icl.com/saxon" lang="xml">
 
<source xmlns:saxon="http://icl.com/saxon" lang="xml">
<[[Config:SampleEvaluator|SampleEvaluator]] id="gridded" type="ibbt.sumo.SampleEvaluators.datasets.GriddedDatasetSampleEvaluator">
+
<[[Config:SampleEvaluator|SampleEvaluator]] id="griddedDataset" type="ibbt.sumo.SampleEvaluators.datasets.GriddedDatasetSampleEvaluator">
 
   <!-- Using an ID you can specify which dataset from the simulator file to use -->
 
   <!-- Using an ID you can specify which dataset from the simulator file to use -->
 
   <!-- <Option key="id" value="someDataset"/> -->
 
   <!-- <Option key="id" value="someDataset"/> -->
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</[[Config:SampleEvaluator|SampleEvaluator]]>
 
</source>
 
</source>
=== scattered ===
+
=== scatteredDataset ===
 
Evaluate samples using a scattered dataset
 
Evaluate samples using a scattered dataset
 
<source xmlns:saxon="http://icl.com/saxon" lang="xml">
 
<source xmlns:saxon="http://icl.com/saxon" lang="xml">
<[[Config:SampleEvaluator|SampleEvaluator]] id="scattered" type="ibbt.sumo.SampleEvaluators.datasets.ScatteredDatasetSampleEvaluator">
+
<[[Config:SampleEvaluator|SampleEvaluator]] id="scatteredDataset" type="ibbt.sumo.SampleEvaluators.datasets.ScatteredDatasetSampleEvaluator">
 
   <!-- Using an ID you can specify which dataset from the simulator file to use -->
 
   <!-- Using an ID you can specify which dataset from the simulator file to use -->
 
   <!-- <Option key="id" value="someDataset"/> -->
 
   <!-- <Option key="id" value="someDataset"/> -->
Line 81: Line 71:
 
       <Option key="pollInterval" value="20"/>
 
       <Option key="pollInterval" value="20"/>
 
       <!--queues we can submit to-->
 
       <!--queues we can submit to-->
       <Option key="queues" value="testqueue,normalprio,myrinet,cmpl_wis-inf"/>
+
       <Option key="queues" value="all.q,fast.q"/>
 
       <!--check for faster queues (more slots available) every xx seconds-->
 
       <!--check for faster queues (more slots available) every xx seconds-->
 
       <Option key="queueRevisionRate" value="10"/>
 
       <Option key="queueRevisionRate" value="10"/>

Revision as of 15:28, 17 July 2008

Generated for SUMO toolbox version 6. We are well aware that the list below is incomplete and possibly even out of date in some cases. We try to document everything as best we can but much is limited by available time and manpower. The most up to date documentation can always be found (if not here) in the default.xml configuration file and, of course, in the source files.

SampleEvaluator

local

Evaluate samples locally using a native executable/script or a java class

<[[Config:SampleEvaluator|SampleEvaluator]] id="local" type="ibbt.sumo.SampleEvaluators.LocalSampleEvaluator">
   <!-- Maximum number of times to resubmit a point (e.g., in case something went wrong) -->
   <Option key="maxResubmissions" value="1"/>
   <!-- If a sample takes longer than "sampleTimeout*average evaluation time of one sample" 
   seconds to evaluate it is removed from the pending list (set to -1 to disable) -->
   <Option key="sampleTimeout" value="-1"/>
   <!-- Can be set to "java" for java executables, to "external" for platform-specific
        binaries and to nothing at all for auto-detection.-->
   <Option key="simulatorType" value=""/>
   <!-- Can be set to a number of seconds, if one simulator evaluation exceeds this timeout,
        the simulation is aborted -->
   <!-- <Option key="timeout" value="12"/> -->
   <!-- Number of samples to evaluate concurrently, useful if you have a dual or multi-core machine -->
   <Option key="threadCount" value="1"/>
</[[Config:SampleEvaluator|SampleEvaluator]]>

matlab

Evaluate samples using a matlab script (ie. your simulator is a matlab script)

<[[Config:SampleEvaluator|SampleEvaluator]] id="matlab" type="ibbt.sumo.SampleEvaluators.matlab.MatlabSampleEvaluator">
   <!-- Maximum number of times to resubmit a point (e.g., in case something went wrong) -->
   <Option key="maxResubmissions" value="1"/>
   <!-- If a sample takes longer than "sampleTimeout*average evaluation time of one sample" 
   seconds to evaluate it is removed from the pending list (set to -1 to disable) -->
   <Option key="sampleTimeout" value="-1"/>
</[[Config:SampleEvaluator|SampleEvaluator]]>

griddedDataset

Evaluate samples using a gridded dataset

<[[Config:SampleEvaluator|SampleEvaluator]] id="griddedDataset" type="ibbt.sumo.SampleEvaluators.datasets.GriddedDatasetSampleEvaluator">
   <!-- Using an ID you can specify which dataset from the simulator file to use -->
   <!-- <Option key="id" value="someDataset"/> -->
</[[Config:SampleEvaluator|SampleEvaluator]]>

scatteredDataset

Evaluate samples using a scattered dataset

<[[Config:SampleEvaluator|SampleEvaluator]] id="scatteredDataset" type="ibbt.sumo.SampleEvaluators.datasets.ScatteredDatasetSampleEvaluator">
   <!-- Using an ID you can specify which dataset from the simulator file to use -->
   <!-- <Option key="id" value="someDataset"/> -->
</[[Config:SampleEvaluator|SampleEvaluator]]>

calcua

Evaluate samples on a SGE administered cluster through a remote, ssh reachable frontnode

<[[Config:SampleEvaluator|SampleEvaluator]] id="calcua" type="ibbt.sumo.SampleEvaluators.sge.RemoteSGESampleEvaluator">
   <!-- Maximum number of times to resubmit a point (e.g., in case something went wrong) -->
   <Option key="maxResubmissions" value="1"/>
   <!-- If a sample takes longer than "sampleTimeout*average evaluation time of one sample" 
        seconds to evaluate it is removed from the pending list (set to -1 to disable) -->
   <Option key="sampleTimeout" value="-1"/>
   
   <!--The platform specs of the cluster-->
   <[[Config:Executable|Executable]] platform="unix" arch="x86"/>
   <[[Config:Backend|Backend]] id="remoteSGE" type="ibbt.sumo.SampleEvaluators.sge.RemoteSGEBackend">
      <!--ssh user name to login on the front node-->
      <Option key="user" value="dgorisse"/>
      <!--Submissions happen from this front node, you need to have key-based ssh authentication-->
      <Option key="frontNode" value="submit.calcua.ua.ac.be"/>
      <!--Directory on the front node where input/output files, dependencies, etc. are stored-->
      <Option key="remoteDirectory" value="/storeA/users/dgorisse/output"/>
      <!--poll for result files every xx seconds-->
      <Option key="pollInterval" value="20"/>
      <!--queues we can submit to-->
      <Option key="queues" value="all.q,fast.q"/>
      <!--check for faster queues (more slots available) every xx seconds-->
      <Option key="queueRevisionRate" value="10"/>
      <!--script on the frontnode that sets up the necessary shell environment-->
      <Option key="environmentCommand" value=". ~/.profile;"/>
   </[[Config:Backend|Backend]]>
</[[Config:SampleEvaluator|SampleEvaluator]]>

begrid

Evaluate samples on a LCG administered grid through a remote, ssh reachable frontnode

<[[Config:SampleEvaluator|SampleEvaluator]] id="begrid" type="ibbt.sumo.SampleEvaluators.edg.RemoteEDGSampleEvaluator">
   <!-- Maximum number of times to resubmit a point (e.g., in case something went wrong) -->
   <Option key="maxResubmissions" value="1"/>
   <!-- If a sample takes longer than "sampleTimeout*average evaluation time of one sample" 
        seconds to evaluate it is removed from the pending list (set to -1 to disable) -->
   <Option key="sampleTimeout" value="-1"/>

   <[[Config:Executable|Executable]] platform="unix" arch="x86"/>
   <[[Config:Backend|Backend]] id="remoteEDG" type="ibbt.sumo.SampleEvaluators.edg.RemoteEDGBackend">
      <Option key="user" value="dgorissen"/>
      <Option key="frontNode" value="ui01.cmi.ua.ac.be"/>
      <Option key="remoteDirectory" value="/home/edp/dgorissen/JobOutput"/>
      <Option key="pollInterval" value="25"/>
      <!--Virtual Organization to use-->
      <Option key="vo" value="betest"/>
      <!--script on the frontnode that sets up the necessary shell environment-->
      <Option key="environmentCommand" value=". /etc/profile;"/>
   </[[Config:Backend|Backend]]>
</[[Config:SampleEvaluator|SampleEvaluator]]>