We currently have several tools for generating experimental designs:
The instructions are brief, so ask for help if you need it!
Orthogonal and nearly orthogonal LH worksheet
This worksheet allows you to specify factor names, low and high levels of interest, and outputs a (nearly) orthogonal LH design in the units of the problem. Version 5 has protected cells for the designs, allows you to specify the number of decimal places of interest, and clarifies that you don't need to use the smallest possible design for a given number of factors. A brief description is available on the "readme" page.
NOB mixed design worksheet
This single worksheet provides flexibility for constructing a 512-design point design suitable for exploring effects of up to 20 discrete k-level factors (k=2,...,11) and 100 continuous factors, for a total of 300 factors. Version 1 has protected cells for the designs, and allows you to specify the number of decimal places of interest. A brief description is available on the "readme" page.
2nd order NOLH design worksheet
This workbook is a tool for making it easier to design large-scale simulation experiments with high-order complex response output behavior. The designs in this worksheet nearly guarantee that all first and second order terms are not confounded with others and provide an excellent space-filling property that enables the detection of model bias and the presence of step functions. Version 1 has designs for up to 12 factors. A brief description is available on the "readme" page.
S-NOLH design worksheet
This workbook contains nearly saturated, nearly orthogonal designs for a variety of design points ranging from 14 to 64. The designs in this worksheet may be of particular interest for those who have larger numbers of factors. The method for constructing the S-NOLH designs can also be used to construct larger designs. Check back soon for an updated version of the spreadsheet that, like the others above, will make it easy to interactively construct a design in the natural units of your problem.
Resolution V fractional factorials
This is an executable jar file for creating resolution V fractional factorials with up to 120 factors. To use it, simply download the file and at the command prompt type
java -jar rf_cubed.jar 8
to create an 8-factor design that will let you look at all main effects and two-way interactions. Replace the "8" with your favorite number of factors (up to 120). The output defaults to the screen but you can redirect it to a file (e.g., "design.txt" by typing
java -jar rf_cubed.jar 8 > design.txt
doe java program
The inputs (as you can see from the two sample files) are the factor name, low and high levels. This version assumes integer-valued variables, and automatically does the necessary rounding. One note: we assumed that the "low" and "high" values input by the user are strict bounds. The interval (high-low) is then divided into the appropriate number of bins, and the midpoint of each bin is used (or rounded to the nearest integer). This means that an range of 0-2 with 4 levels will result in a base set of values 0, 1, 1, 2 (i.e., sampling more heavily in the center).
The program reads inputs token by token, where a token is defined to be non-white-space surrounded by white-space. In other words, you can put all of the input on one line, one line per factor, or one line per value, it doesn't matter to this version. I've included two input files for testing, one with data one element per line and one with one factor per line. You can also specify a command line argument for the number of (independent) LH designs to generate and append to one another. This is a way of reducing multicollinearity among the columns of factor settings. For example, Eric Wolf appended 4 40-run LH's to come up with his design.
The "doe3.jar" file is an executable jar file that contains the software and Javadoc documentation. The files "testlh1" and "testlh2" are sample input files. You can run this from a command window using the command "java -jar doe3.jar [#] <designspecfile", where "designspecfile" is an input file containing the factors and their bounds and "[#]" is an optional number specifying how many times to replicate the design.
S-plus script for Latin Hypercubes
Here is an S-plus script that will go ahead and generate LH designs. The "test material" at the end shows how to generate the design, so if you run the script you can get the output.
Note that the output design is given in the units of the problem, rather than scaled from -1 to 1 or given in integers corresponding to the ranks
XStudy, Version 1.0
The XStudy application is a graphical user interface for generating a study.xml file. A study.xml file is an XML file that specifies how a user wants to conduct a simulation experiment (Note: more details on what is included in the study.xml file can be found in the OldMcData documentation, downloaded separately -see below). The file has meta-data information about the study, including such elements as the name of the experimenter, and a description of the study, among other things. It also includes information about the model used, the number of replications desired, initial random seeds, and specification of the algorithm to use for generating the parameter variations, as well as what variables are to be used for that variation. Specifying the variables is done using the XPath specification (http://www.w3.org/TR/xpath) and its use is at the heart of the study.xml. As such, XStudy uses the XPaths of the variables within a scenario file to identify the parameters that are to be varied
To download version 1.0, click on the link below. File size is approximately 880 KB.
To install, unzip xstudy.zip into a directory of your choice, e.g., C:\xstudy if you are on a Windows-based machine, or Users/username/xstudy for a Unix-based machine. Once unzipped, take a look at the readme file, Readme.xstudy-031408.pdf. If you have any questions, comments, or suggestions, please email Steve Upton
xstudy.zipOldMcData, Version 1.1
OldMcData - The Data Farmer (OMD) is a software application designed to do data farming runs, from running large simulation experiments on a distributed computer cluster to multiple replications of a single excursion on a single machine. For runs on a distributed computing cluster, OMD uses Condor (http://www.cs.wisc.edu/condor/) an open-source distributed computing environment, to handle the scheduling and managing of the running jobs.
OMD uses an XML formatted specification of your simulation experiment, called a study.xml file (see the OMD User's Manual for more details on this specification). The study.xml file includes information about the model, a listing of the input variables or factors in your experiment, the type of algorithm you want to use to read in or create the values for the input variables, and other administrative information such as the user's contact information. This file can be created manually using any text editor, or using the graphical front-end called XStudy (see above).
To download version 1.1, click on the link below. File size is approximately 12.9 MB.
To install, unzip omd1.1.zip into a directory of your choice, e.g., C:\omd1.1 if you are on a Windows-based machine, or Users/username/omd1.1 for a Unix-based machine. Once unzipped, take a look at the Quick Start guide, QuickStart.html, or the OMD User's Manual in the "docs" folder. If you have any questions, comments, or suggestions, please email Steve Upton
omd1.1.zipSeveral versions of the MANA and Pythagaros Agent-based software are available for downloading by authorized users. Your affiliation determines which model and versions you are authorized to download.
If you are interested in downloading MANA or Pythagoras, please send email to request a username and password. Please include one of the below affiliations so we can properly handle your request.
NOTE: We are only authorized to distribute MANA to NPS Students and Faculty; all other users can contact David Galligan of the MANA team at d.galligan@dta.mil.nz.
NPS Students and Faculty
For NPS Students and Faculty, the following models and tools are available using the "Download for NPS" button below:
You will need to be at an NPS machine or VPNd in. The download button below will direct you to a password protected download page. If you are interested in downloading any of the models above but you do not have a username and password, please email to request a username and password.
This username and password are NOT the same as your NPS username and passwords.US Government and their affiliates
For government users and their affiliates, the following models and tools are available using the "Download for USGovt" button below:
The download button below will direct you to a password protected download page. If you are interested in downloading any of the models above but you do not have a username and password, please email to request a username and password.
All Other Users
For other, authorized users, the following models and tools are available using the "Download for Other Users" button below:
The download button below will direct you to a password protected download page. If you are interested in downloading any of the models above but you do not have a username and password, please email to request a username and password.
Download for Other UsersDisclaimer: This represents an individual Web page at the Naval Postgraduate School.
Disclaimer: This individual Web page at the Naval Postgraduate School contains links to external sites.