/* * Main authors: * Guido Tack * * Copyright: * Guido Tack, 2008 * * Last modified: * $Date: 2008-01-31 10:36:59 +0100 (Thu, 31 Jan 2008) $ by $Author: tack $ * $Revision: 6001 $ * * This file is part of Gecode, the generic constraint * development environment: * http://www.gecode.org * * Permission is hereby granted, free of charge, to any person obtaining * a copy of this software and associated documentation files (the * "Software"), to deal in the Software without restriction, including * without limitation the rights to use, copy, modify, merge, publish, * distribute, sublicense, and/or sell copies of the Software, and to * permit persons to whom the Software is furnished to do so, subject to * the following conditions: * * The above copyright notice and this permission notice shall be * included in all copies or substantial portions of the Software. * * THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, * EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF * MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND * NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE * LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION * OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION * WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. * */ /** \page PageReflection The Reflection API Reflection in %Gecode provides information about all the actors (propagators and branchings) and the variables in a Space. %Gecode also enables the reverse direction: creating a variable or actor in a space, given a specification. Some use cases for reflection are - \b %Serialization, which creates an external, platform-independent representation of a space that can be used to recreate a copy of the original space. This facilitates the development of distributed search engines, makes it possible to store instances of constraint problems, and can be used to transfer a problem instance from one solver to another. - \b Visualization of variable domains or the propagators in a space can help with debugging scripts or propagators. %Gecode's Gist uses reflection for visualization. - \b Interfacing to other programming languages becomes easy, because only the generic unreflection functions have to be made available. The Qt-based JavaScript interpreter in examples/javascript.cc builds on reflection. - \b Heuristics can be based on properties of the constraint graph, which is effectively exposed by the reflection API. This tutorial is split in two parts: - \ref SecReflUsage - \ref SecReflAddSupport \section SecReflUsage Using the reflection API The starting point for reflection in %Gecode is a Space. The basic work cycle is to iterate over all the actors in a space using an ActorSpecIter, collecting the variables that the actors reference in a VarMap. The iterator returns an ActorSpec for each actor, and the VarMap contains a VarSpec for each variable. All the specifications in the VarMap can be accessed using a VarMapIter. \code Gecode::Space* space = ... Gecode::Reflection::VarMap vm; Gecode::Reflection::VarMapIter vmi(vm); for (Gecode::Reflection::ActorSpecIter si(space, vm); si(); ++si) { Gecode::Reflection::ActorSpec aSpec = si.actor(); doSomethingForAnActor(aSpec); for (; vmi(); ++vmi) { Gecode::Reflection::VarSpec vSpec = vmi.spec(); doSomethingForAVariable(vSpec); } } \endcode Note that new variables are added to \c vm when the specification for an actor is accessed (using \c si.actor()). The VarMapIter therefore always iterates all those variables that were added to \c vm for the current actor. We will now go into the details of ActorSpec and VarSpec, and after that discuss the VarMap and the unreflection mechanism. \subsection SecReflUsageSpecs Accessing the specifications Specifications for actors and variables are similar. For each actor or variable, a specification contains a Symbol (a string) representing its type (accessed as \c ActorSpec::ati resp. \c VarSpec::vti), and a term representing its state (e.g. the current variable domain for variables, or the arguments of a propagator). Terms are represented as objects of the class Reflection::Arg and can be summarized by the following grammar: \verbatim term ::= INT | VAR | STRING | [term,...,term] | [INT,...,INT] | (term,term) | sharedObject(term) | sharedReference(INT) \endverbatim The upper-case constructors stand for actual values; signed integers for \c INT, character pointers for \c STRING, and integers for \c VAR : variables are represented as indices into the VarMap. The second line shows term constructors for arrays and pairs. There is special support for integer arrays. The constructors for shared objects in the third line have a similar purpose as the \c VAR constructor: a term, e.g. an array, that is shared between several actors, is introduced using a \c sharedObject constructor, and later referenced by a \c sharedReference. The shared references are counted in the order in which the shared objects are encountered. The concrete representation of a variable's or actor's state depends on its concrete implementation. The following list will give you an idea of possible encodings: - Domains of integer variables are encoded as arrays of integers, where two consecutive integers represent a range in the domain. For example, the domain \f$\{0,1,2,4,5,8\}\f$ would be represented as \c [0,2,4,5,8,8]. - The arguments of the distinct constraint with offsets are encoded as an array of pairs of integers and variables, like \c [(0,q0),(-1,q1),(-2,q2),(-3,q3)] for the Queens model. - The DFA of an extensional constraint that uses a LayeredGraph is encoded into an array of integers, where each transition is represented by three integers, one for the input state, one for the symbol, and one for the output state. As DFAs can be shared between several propagators, they are wrapped in a \c sharedObject or \c sharedReference. \subsection SecReflUsageVarMap The VarMap Several propagators can share the same variable, and reflection makes this sharing explicit. The VarMap contains one entry per variable that is referenced by an actor, and it is filled by iterating over the actors. The specification of an actor only contains an integer reference into the VarMap that was used when the specification was created. Reflection of variables is similar to copying, as only those variables will be put into a VarMap that are reachable from the actors. As with copying, variables can be added manually. Furthermore, a VarMap can store a \em name for each variable. The Space class has a virtual function Gecode::Space::getVars, which is used to fill a VarMap with the variables that the user is interested in. The Queens example shows how to use \c getVars: \code class Queens : public Example { public: virtual void getVars(Gecode::Reflection::VarMap& vm, bool registerOnly) { vm.putArray(this,q,"q", registerOnly); } }; \endcode The parameter \c registerOnly is needed for unreflection. \subsection SecReflUsageUnref Unreflection With unreflection, %Gecode can create variables and actors in a space from a VarSpec or ActorSpec. The unreflection mechanism can be used for deserialization, or to implement an interface to %Gecode. Assuming that the actor and variable specifications were stored in vectors, the basic setup for unreflection looks like this: \code void unreflect(Space* home, std::vector& as, std::vector& vs) { Gecode::Reflection::VarMap vm; Gecode::Reflection::Unreflector ur(home, vm); for (std::vector::iterator it=vs.begin(); it != vs.end(); ++it) { ur.var(*it); // Create variables from specifications } for (std::vector::iterator it=as.begin(); it != as.end(); ++it) { ur.post(*it); // Post actors from specifications } } \endcode After unreflection, the VarMap contains the created variables. If the variable specifications had names for the variables, the new variables can be accessed via their names, otherwise, they can only be accessed by their index into the VarMap. The indices are consecutive integers, starting at 0, and assigned in the order in which the variables were created. The VarMap can be filled \em before you use unreflection. That way, existing variables can be mapped to the new variables via names, and the actors created by unreflection are posted on the existing variables. This is the purpose of the \c registerOnly argument of Gecode::Space::getVars. If it is \c true, only the names of the variables will be registered, but no index will be assigned for the variable in the VarMap: \code ... Gecode::Reflection::VarMap vm; home->getVars(vm, true); // Register variables Gecode::Reflection::Unreflector ur(home, vm); for (std::vector::iterator it=vs.begin(); it != vs.end(); ++it) { ... \endcode \subsection SecReflUsageGenericVars Generic variables %Gecode provides a generic variable class, Gecode::Reflection::Var. Generic variables can be obtained from any variable class that supports reflection. They provide a dynamically type-safe way of handling inhomogeneous collections of variables, for instance a \c VarArray that contains both integer and set variables. All variables can be constructed from a generic variable. At construction, a dynamic check is performed that guarantees that the generic variable is actually an instance of the variable type that is constructed. The variables in a VarMap can be accessed as generic variables: \code ... Gecode::Space* home = ... Gecode::Reflection::VarMap vm; space->getVars(vm); Gecode::Reflection::Var v = vm.var(0); // Get variable at index 0 Gecode::IntVar i(v); // Construct IntVar (with dynamic type check) \endcode \subsection SecReflUsageBranchingSpec Branching specifications A Gecode::Reflection::BranchingSpec provides a human-readable description of a Gecode::BranchingDesc. This is e.g. used by Gist, so that the user can see what actions the branchings took at each branch in the search tree. A BranchingSpec contains one ArrayArg per alternative, and each ArrayArg may only contain strings and variable references. The string concatenation of these arguments yields a human-readable description of the alternative: \code void printAlternatives(Gecode::Space* home) { if (home->status() != SS_BRANCH) { std::cout << "no alternatives left" << std::endl; return; } const Gecode::BranchingDesc* d = space->description(); Gecode::Reflection::VarMap vm; space->getVars(vm, false); Gecode::Reflection::BranchingSpec bs = space->branchingSpec(vm,d); delete d; std::cout << "Alternatives:" << std::endl; for (unsigned int i=0; itoArray(); for (int j=0; jisString()) { std::cout << aa[j]->toString(); } else if (aa[j]->isVar()) { int v = aa[j]->toVar(); if (vm.hasName(v)) std::cout << vm.name(v).toString(); else std::cout << "_v" << v; } } std::cout << std::endl; } } \endcode \subsection SecReflUsageMemory Memory management All the reflection classes provide memory management. This means that you must not free the argument objects, they are automatically deallocated when the ActorSpec, VarSpec, or BranchingSpec is deallocated. Copying specifications is cheap, as all classes use reference counting. \subsection SecReflUsageInterfacing Interfacing to Gecode through reflection The (un-)reflection API makes interfacing to %Gecode very easy. We provide a full JavaScript interface (through TrollTech's Qt library), and it only requires 150 lines of code. An interface can benefit from reflection in three ways: - The generic Gecode::Reflection::Var class leaves the C++ part of the interface independent of the actual variable types that are supported. Every variable type supported by %Gecode is automatically supported by the interface. - Instead of a post function for every propagator and branching and variable creation functions for all the variable types, only the Gecode::Reflection::Unreflector has to be exported. - All propagators and branchings that are supported by %Gecode are immediately available through the interface. When propagators are added to %Gecode, no new interfacing code has to be written. If the propagators are added as additional libraries, the interface does not even have to be recompiled. Please refer to \ref PageReflectionRegistry for more information on the propagators that are available through unreflection. \section SecReflAddSupport Adding reflection support to actors and variables When the ActorSpecIter iterates over the actors of a space, each actor has to deliver its specification through the virtual function Actor::spec. When this function is called, the actor creates an ActorSpec with its actor type identifier (ati) and fills it with a representation of its arguments, encoded into objects of type Reflection::Arg. The specification for the views is delegated to the views or view arrays that the actor uses. We now go through the steps that are needed for reflection of actors and variables. \subsection SecReflAddSupportProp Propagators Propagators implement the virtual function Gecode::Reflection::Actor::spec. It creates an ActorSpec with a proper actor type identifier and arguments. The following example provides reflection for a propagator with an IntView \c x, a ViewArray of IntViews \c y, and an integer constant \c c: \code class MyPropagator : public Gecode::Propagator { protected: IntView x; ViewArray y; int c; public: // Return specification for reflection virtual Gecode::Reflection::ActorSpec spec(const Space* home, Gecode::Reflection::VarMap& m) const { Gecode::Support::Symbol ati("MyPropagator"); Gecode::Reflection::ActorSpec spec(ati); spec << x.spec(home, m); spec << y.spec(home, m); spec << c; return spec; } }; \endcode For a generic propagator, the types of its views must be part of the actor type identifier. All views have a static function \c type to enable this, and the reflection library contains name mangling functions: \code template class MyGenericPropagator : public Gecode::Propagator { protected: View0 x; ViewArray y; int c; public: // Return specification for reflection virtual Gecode::Reflection::ActorSpec spec(const Space* home, Gecode::Reflection::VarMap& m) const { Gecode::Support::Symbol ati = Gecode::Reflection::mangle("MyGenericPropagator"); Gecode::Reflection::ActorSpec spec(ati); spec << x.spec(home, m); spec << y.spec(home, m); spec << c; return spec; } }; \endcode For unreflection, the actor must be \em registered. %Gecode contains a global Gecode::Reflection::registry, mapping actor type identifiers to post functions. In order to register a propagator, the propagator class has to provide two static functions, \c ati and \c post. Then the Gecode::Reflection::ActorRegistrar class can be used, or more conveniently, the \c GECODE_REGISTER macros. Here is a complete example: \code template class MyGenericPropagator : public Gecode::Propagator { protected: View0 x; ViewArray y; int c; public: // Constructor MyGenericPropagator(Space*,View0,ViewArray&,int); // Actor type identifier static Gecode::Symbol ati(void) const { return Gecode::Reflection::mangle("MyGenericPropagator"); } // Return specification for reflection virtual Gecode::Reflection::ActorSpec spec(const Space* home, Gecode::Reflection::VarMap& m) const { Gecode::Reflection::ActorSpec spec(ati()); spec << x.spec(home, m); spec << y.spec(home, m); spec << c; return spec; } // Posting the propagator from a specification static void post(Space* home, Reflection::VarMap& vars, const Reflection::ActorSpec& spec) { spec.checkArity(3); View0 x(home, vars, spec[0]); ViewArray y(home, vars, spec[1]); int c = spec[2]->toInt(); (void) new (home) MyGenericPropagator(home,x,y,c); } }; \endcode Using the static function \c ati for both registration and reflection (in \c spec) makes sure that the type identifiers are the same. The function \c checkArity makes sure that \c spec contains exactly 3 arguments and throws an exception otherwise. The accessor functions (like Gecode::Reflection::Arg::toInt) also check that the argument type matches. The reflection constructors for views and view arrays use these accesor functions, so an incorrect view type will be detected. Now we can register the propagator. Note that we have to register each \em instance separately: \code namespace { GECODE_REGISTER2(MyGenericPropagator); GECODE_REGISTER2(MyGenericPropagator); } \endcode \subsection SecReflAddSupportBranching Branchings Actor reflection for branchings is, in principle, the same as for propagators. However, if you subclass Gecode::ViewValBranching, all you have to provide are \c type functions in your view and value selection classes. See Gecode::Int::Branch::ByNone::type and Gecode::Int::Branch::ValMin::type for examples. Branchings provide a second type of reflection. Given a Gecode::BranchingDesc, they can deliver a Gecode::Reflection::BranchingSpec. For this to work, you have to implement the virtual function Gecode::Branching::branchingSpec. Please see the Gecode::ViewValBranching and the corresponding value selectors (Gecode::Int::Branch::ValMin::branchingSpec) for examples. \subsection SecReflAddSupportVar Variables and Views Reflection for variables and views is similar to reflection for actors. Each view class provides two functions: \code class MyView { public: Reflection::Arg* spec(const Space* home, Reflection::VarMap& m) const; static Support::Symbol type(void); }; \endcode Views delegate the reflection of the underlying variable to the variable implementation and just add their own arguments. For a concrete example, see Gecode::Int::IntVarImp::spec and Gecode::Int::OffsetView::spec. The \c spec function of a view returns a reference to a variable. As a side effect, the actual VarSpec is entered into the VarMap. Views and variables also have constructors for unreflection. Again, the Views delegate unreflection of the underlying variable. See Gecode::IntVar::IntVar(const Gecode::Reflection::Var&) and Gecode::Int::IntView::IntView(Space*, const Reflection::VarMap&, Reflection::Arg*). For unreflection, the registry contains functions for creating, constraining, updating, and printing variable implementations. If a variable implementation implements the two functions \c create and \c constrain, it can be registered using a Gecode::Reflection::VarImpRegistrar. The generic variables (Gecode::Reflection::Var) use the registry to perform updates. For an example of how to implement the necessary functionality, see Gecode::Int::IntVarImp. */ /** \page PageReflectionRegistry The Reflection Registry The registry maps an actor type identifier (ati) to a function that posts the corresponding constraint. The type of these post functions is defined in the registry as \code class Registry { public: /// The type of constraint posting functions typedef void (*poster) (Gecode::Space*, Gecode::Reflection::VarMap&, const Gecode::Reflection::ActorSpec&); }; \endcode There are two kinds of post functions in the registry: - One function per actor instance. These functions correspond directly to individual propagators and branchings. For instance, the registry contains a function for the ati \c Int::Distinct::Dom. Each propagator registers one post function per instance. The registry is populated with these post functions as soon as the library in which the propagator is defined is loaded. - One function per constraint post function (the functions found in gecode/int.hh or gecode/set.hh, for example). The functions are useful for interfacing to Gecode, as they provide a higher-level interface to the propagators. For example, the registry contains a post function for the ati \c Gecode::rel. Depending on the arguments given in the ActorSpec, this function can post any of the \c rel constraints found in gecode/int.hh and gecode/set.hh. All high-level post functions are registered when the serialization library is loaded, which can be triggered by callling Gecode::Serialization::initRegistry. \section SecRegistryArgMapping Mapping arguments to ActorSpecs The high-level post functions are generated automatically from the post functions in gecode/int.hh and gecode/set.hh. The argument types are mapped automatically to Gecode::Reflection::Arg terms.
C++ argument type Reflection::Arg type Comment
\c int\c INT
unsigned int\c INT
\c bool\c INT
\c IntVar\c VAR
\c BoolVar\c VAR
\c SetVar\c VAR
\c IntVarArgs[VAR,...,VAR]
\c BoolVarArgs [VAR,...,VAR]
\c SetVarArgs[VAR,...,VAR]
\c IntArgs[INT,...,INT]
\c IntSet[INT,...,INT] Two consecutive integers are interpreted as a range
\c IntSetArgs[[INT,...,INT],...,[INT,...,INT]] Same representation as for IntSet
Any enumerationSTRING The string representation of the enum value, e.g. \c "IRT_EQ"
*/