= Demonstrations
== Steps
QED demos are light-weight specification documents, highly suitable
to interface-driven design. The documents are divided up into
steps separated by blank lines. Steps that are flush to the
left margin are always explanatory comments. Indented steps are
either executable code or plain text samples.
Each step is executed in order of appearance within a rescue wrapper
that captures any failures or errors. If neither a failure or error
occur then the step gets a "pass".
For example, the following passes.
(2 + 2).assert == 4
While the following would "fail", as indicated by the raising of
an Assertion error.
expect Assertion do
(2 + 2).assert == 5
end
And this would have raised a NameError.
expect NameError do
nobody_knows_method
end
== Defining Custom Assertions
The context in which the QED code is run is a self-extended module, thus
reusable macros can be created simply by defining a method.
def assert_integer(x)
x.assert.is_a? Integer
end
Now lets try out our new macro definition.
assert_integer(4)
Let's prove that it can also fail.
expect Assertion do
assert_integer("IV")
end
= Advice
Advice are event-based procedures that augment demonstrations.
They are used to keep demonstrations clean of extraneous,
repetitive and merely adminstrative code that the reader does
not need to see over and over.
Typically you will want to put advice definitions is applique
files, rather then place them directly in the demonstration
document, but you can do so, as you will see in this document.
== Before and After
QED supports *before* and *after* clauses in a specification
through the use of Before and After code blocks. These blocks
are executed at the beginning and at the end of each indicated
step.
We use a *before* clause if we want to setup some code at the
start of each code step.
a, z = nil, nil
Before do
a = "BEFORE"
end
And an *after* clause to teardown objects after a code step.
After do
z = "AFTER"
end
Notice we assigned +a+ and +z+ before the block. This was to ensure
their visibility in the scope later. Now, lets verify that the *before*
and *after* clauses work.
a.assert == "BEFORE"
a = "A"
z = "Z"
And now.
z.assert == "AFTER"
There can be more than one before and after clause at a time. If we
define a new *before* or *after* clause later in the document,
it will be appended to the current list of clauses in use.
As a demonstration of this,
b = nil
Before do
b = "BEFORE AGAIN"
end
We will see it is the case.
b.assert == "BEFORE AGAIN"
Only use *before* and *after* clauses when necessary --specifications
are generally more readable without them. Indeed, some developers
make a policy of avoiding them altogether. YMMV.
== Caveats of Before and After
Instead of using Before and After clauses, it is wiser to
define a reusable setup method. For example, in the helper
if we define a method such as #prepare_example.
def prepare_example
"Hello, World!"
end
Then we can reuse it in later code blocks.
example = prepare_example
example.assert == "Hello, World!"
The advantage to this is that it gives the reader an indication
of what is going on behind the scenes, rather the having
an object just magically appear.
== Event Targets
There is a small set of advice targets that do not come before or after,
rather they occur *upon* a particular event. These include +:load+
and +:unload+ for when a new helper is loaded; +:pass+, +:fail+ and +:error+
for when a code block passes, fails or raises an error; and +:head+, +:desc:+,
+:code+ and +:data:+ which targets the immediate processing of a text block
and code excecution.
These event targets can be advised by calling the +When+ method
with the target type as an argument along with the code block
to be run when the event is triggered.
x = []
When(:text) do |section|
section.text.scan(/^\*(.*?)$/) do |m|
x << $1.strip
end
end
Not let see if it worked.
* SampleA
* SampleB
* SampleC
So +x+ should now contain these three list samples.
x.assert == [ 'SampleA', 'SampleB', 'SampleC' ]
== Pattern Matchers
QED also supports comment match triggers. With the +When+ method one can
define procedures to run when a given pattern matches comment text.
When 'given a setting @a equal to (((\d+)))' do |n|
@a = n.to_i
end
Now, @a will be set to 1 whenever a comment like this one contains,
"given a setting @a equal to 1".
@a.assert == 1
A string pattern is translated into a regular expression. In fact, you can
use a regular expression if you need more control over the match. When
using a string all spaces are converted to \s+ and anything within
double-parenthesis is treated as raw regular expression. Since the above
example has (((\d+))), the actual regular expression contains (\d+),
so any number can be used. For example, "given a setting @a equal to 2".
@a.assert == 2
When clauses can also use consecutive pattern matching. For instance
we could write,
When 'first match #(((\d+)))', 'then match #(((\d+)))' do |i1, i2|
@a = [i1.to_i, i2.to_i]
end
So that 'first match #1' will be looked for first, and only after
that if 'then match #2' is found, will it be condiered a complete match.
All regular expression slots are collected from all matches and passed to
the block. We can see that the rule matched this very paragraph.
@a.assert == [1,2]
This concludes the basic overview of QED's specification system, which
is itself a QED document. Yes, we eat our own dog food.
= Helpers
There are two ways to load advice scripts. Either per
demonstration or globally. Per demonstration helpers
apply only to the current demonstration. Global helpers
apply to all demonstrations.
== Global Helpers
Global helpers are loaded at the start of a session and
apply equally to all demonstrations in a suite. Global
helpers are simply Ruby scripts and are placed in an
+environment+ subdirectory. For instance this document
is used environment/env.rb.
== Local Helpers
Helper scripts can be written just like demonstration scripts,
or they can be defined as pure Ruby scripts. Either way
they are loaded per-demonstration by using specially
marked links.
For example, because this link, Advice[qed://helpers/advice.rb],
begins with +qed:+, it will be used to load a global
helper. We can see this with the following assertion.
pudding.assert.include?('load advice.rb')
No where in the demonstration have we defined +pudding+, but
it has been defined for us in the advice.rb helper script.
We can also see that the generic When clause in our advice
helper is keeping count of decriptive paragraphs. Since the
helper script was loaded two paragraphs back, the next count
will be 3.
count.assert == 3
Helpers are vital to building test-demonstration suites for
applications. But here again, only use them as necessary.
The more helpers you use the more difficult your demos will
be to follow.
= Test Samples
== Flat-file Data
When creating testable demonstrations, there are times when sizable
chunks of data are needed. It is convenient to store such data in
separate files. The +Data+ method makes is easy to utilize them.
Data('qed/samples/data.txt').assert =~ /dolor/
The +Data+ method can also take a block which passes the data
as the block's only argument.
Data('qed/samples/data.txt') do |data|
data.assert =~ /dolor/
end
Files are looked-up relative to the location of the current document.
If not found then they will be looked-up relative to the current
working directory.
== Tabular Data
The +Table+ method is similar to the +Data+ method except that it
expects a YAML file, and it can take a block to iterate the data over.
This makes it easy to test tables of examples.
The arity of the table block corresponds to the number of columns in
each row of the table. Each row is assigned in turn and run through
the coded step. Consider the following example.
Every row in the {table.yml table}[table.yml] will be assigned to
the block parameters and run through the subsequent assertion.
Table 'qed/samples/table.yml' do |x, y|
x.upcase.assert == y
end
Without the block, the +Table+ methods simply returns the sample data.
== Considerations
Both Data and Table are some what "old fashion" approches to sample
data. New techinques using plain text blocks are more convenient
in that the data can be stored directly in the demonstration itself.
However, for especially large data sets and external file is still
the better option, and +Data+ and +Table+ make them quite easy to
access.
= Quotes
We do not always want verbatim clauses to be interpreted as code.
Sometimes it would more useful to treat them a plain text to
which the preceeding paragraph can make use in a processing rule.
For example let say we want to make an example out of the following
text...
The file will contain
this text
The use of the ellipsis ('...') tells the processor that the next
segment is a plain text continuation of the current segment, rather
than example code. If the next segment is varbatim it will be added to
the end of the arguments list of any applicable processing rule.
Behind the scenes we created a rule to set the text to an instance
variable called @quote_text, and we can verify it is so.
@quote_text.assert == "The file will contain\n\nthis text"
Alternately we can use a colon (':') instead of ellipsis. We can repeat
the same statment as above.
For example let say we want to make an example out of the following
text:
The file will contain
different text
And again we can verify that it did in fact set the @quote_text variable.
@quote_text.assert == "The file will contain\n\ndifferent text"
= Toplevel Simulation
QED simulates Ruby's TOPLEVEL environment in both the Demonstrandum
and the Applique contexts. This serves two important purposes.
First, it provides the tester the environment that is most intutive.
And second, and more importantly, it stays out of the actual
TOPLEVEL space to prevent any potential interferece with any of
the code it is intended to test.
Let's look at some examples. For starters, we have access to a class
defined at the "toplevel" in the applique.
ToplevelClass
We can also call a method defined in the toplevel.
toplevel_method.assert == true
At the demonstrandum level we can define reusable methods.
def demo_method
true
end
demo_method.assert == true
And at the demonstrandum level even singleton methods are accessible.
def self.singleton_method; true; end
singleton_method.assert == true
QED uses a self-extend modules to achieve this simulation, so the
contexts are in fact a bit more capable then even Ruby's TOPLEVEL.
For instance, #define_method can be used.
define_method(:named_method){ true }
named_method.assert == true
= Cross-Scripting Setup
We define some variables here to make sure it is
not visible in the next script.
Let's set two local variables.
a = 100
b = 200
And two instance varaibles.
@a = 1000
@b = 2000
Also let check how it effect constants.
CROSS_SCRIPT_CONSTANT = "cross?"
And a method.
def cross_script_method
"common"
end
= Cross-Scripting Check
Make sure local and instance variables from previous
QED scripts are not visible in this document.
expect NameError do
a.assert = 100
b.assert = 200
end
And two instance_varaibles
@a.assert! == 1000
@b.assert! == 2000
Method definitions also do not cross QED scripts.
expect NameError do
cross_script_method
end
Since each demo is encapsulated in a separated class scope, constants also
do not make their way across.
expect NameError do
CROSS_SCRIPT_CONSTANT
end
= Missing Constant
If a constant is missing it is because it was not found
in either the demos scope, the applique or the toplevel.
begin
UnknownConstant
rescue => err
# no colon means toplevel
/[^:]UnknownConstant/ =~ err.message
end
A constant defined in the applique is visible.
APPLIQUE_CONSTANT.assert = true