package Test::Most; use warnings; use strict; # XXX don't use 'base' as it can override our signal handlers use Test::Builder::Module; our ( @ISA, @EXPORT ); use Test::More; use Test::Differences; use Test::Exception; use Test::Deep; use Test::Warn; use Test::Builder; my $OK_FUNC; BEGIN { $OK_FUNC = \&Test::Builder::ok; } =head1 NAME Test::Most - Most commonly needed test functions and features. =head1 VERSION Version 0.11 =cut our $VERSION = '0.11'; =head1 SYNOPSIS B: This is beta code. It seems to work well, but use with caution. The prior version (0.01) was alpha, but it's been stable and people are happy with it. This module provides you with the most commonly used testing functions and gives you a bit more fine-grained control over your test suite. use Test::Most tests => 4, 'die'; ok 1, 'Normal calls to ok() should succeed'; is 2, 2, '... as should all passing tests'; eq_or_diff [3], [4], '... but failing tests should die'; ok 4, '... will never get to here'; As you can see, the C test will fail. Because 'die' is in the import list, the test program will halt at that point. =head1 EXPORT All functions from the following modules will automatically be exported into your namespace: =over 4 =item * C =item * C =item * C =item * C =item * C =back Functions which are I exported from any of those modules must be referred to by their fully-qualified name: Test::Deep::render_stack( $var, $stack ); =head1 FUNCTIONS Several other functions are also automatically exported: =head2 C die_on_fail; is_deeply $foo, bar, '... we die if this fails'; This function, if called, will cause the test program to die if any tests fail after it. =head2 C bail_on_fail; is_deeply $foo, bar, '... we bail out if this fails'; This function, if called, will cause the test suite to BAIL_OUT() if any tests fail after it. =head2 C die_on_fail; is_deeply $foo, bar, '... we die if this fails'; restore_fail; cmp_bag(\@got, \@bag, '... we will not die if this fails'; This restores the original test failure behavior, so subsequent tests will no longer die or BAIL_OUT(). =head2 C Similar to C, but only outputs the message if C<$ENV{TEST_VERBOSE}> is set. This is typically set by using the C<-v> switch with C. Unlike C, any reference in the argument list is autumatically expanded using C. Thus, instead of this: my $self = Some::Object->new($id); use Data::Dumper; explain 'I was just created', Dumper($self); You can now just do this: my $self = Some::Object->new($id); explain 'I was just created: ', $self; That output will look similar to: I was just created: bless( { 'id' => 2, 'stack' => [] }, 'Some::Object' ) Note that the "dumpered" output has the C variables C<$Indent>, C and C all set to the value of C<1> (one). This allows for a much cleaner diagnostic output and at the present time cannot be overridden. Requires C 3.07 or greater. =head2 C If the plan is specified as C, you may call C<&all_done> at the end of the test with an optional test number. This lets you set the plan without knowing the plan before you run the tests. If you call it without a test number, the tests will still fail if you don't get to the end of the test. This is useful if you don't want to specify a plan but the tests exit unexpectedly. For example, the following would I with C but fails with C. use Test::More 'defer_plan'; ok 1; exit; ok 2; all_done; See L for more information. =head1 DIE OR BAIL ON FAIL Sometimes you want your test suite to die or BAIL_OUT() if a test fails. In order to provide maximum flexibility, there are three ways to accomplish each of these. =head2 Import list use Test::Most 'die', tests => 7; use Test::Most qw< no_plan bail >; If C or C is anywhere in the import list, the test program/suite will C or C as appropriate the first time a test fails. Calling C anywhere in the test program will restore the original behavior (not dieing or bailing out). =head2 Functions use Test::Most 'no_plan; ok $bar, 'The test suite will continue if this passes'; die_on_fail; is_deeply $foo, bar, '... we die if this fails'; restore_fail; ok $baz, 'The test suite will continue if this passes'; The C and C functions will automatically set the desired behavior at runtime. =head2 Deferred plans use Test::Most qw; use My::Tests; my $test_count = My::Tests->run; all_done($test_count); Sometimes it's difficult to know the plan up front, but you can calculate the plan as your tests run. As a result, you want to defer the plan until the end of the test. Typically, the best you can do is this: use Test::More 'no_plan'; use My::Tests; My::Tests->run; But when you do that, C merely asserts that the number of tests you I is the number of tests. Until now, there was no way of asserting that the number of tests you I is the number of tests unless you do so before any tests have run. This fixes that problem. =head2 Environment variables DIE_ON_FAIL=1 prove t/ BAIL_ON_FAIL=1 prove t/ If the C or C environment variables are true, any tests which use C will die or call BAIL_OUT on test failure. =head1 RATIONALE People want more control over their test suites. Sometimes when you see hundreds of tests failing and whizzing by, you want the test suite to simply halt on the first failure. This module gives you that control. As for the reasons for the four test modules chosen, I ran code over a local copy of the CPAN to find the most commonly used testing modules. Here were the top ten (out of 287): Test::More 44461 Test 8937 Test::Exception 1379 Test::Simple 731 Test::Base 316 Test::Builder::Tester 193 Test::NoWarnings 174 Test::Differences 146 Test::MockObject 139 Test::Deep 127 The four modules chosen seemed the best fit for what C is trying to do. As of 0.02, we've added L by request. It's not in the top ten, but it's a great and useful module. =cut BEGIN { @ISA = qw(Test::Builder::Module); @EXPORT = ( @Test::More::EXPORT, @Test::Differences::EXPORT, @Test::Exception::EXPORT, @Test::Differences::EXPORT, @Test::Deep::EXPORT, @Test::Warn::EXPORT, qw< explain restore_fail die_on_fail bail_on_fail all_done > ); if ( Test::Differences->VERSION <= 0.47 ) { # XXX There's a bug in Test::Differences 0.47 which attempts to render # an AoH in a cleaner 'table' format. # http://rt.cpan.org/Public/Bug/Display.html?id=29732 no warnings 'redefine'; *Test::Differences::_isnt_HASH_of_scalars = sub { return 1 if ref ne "HASH"; return scalar grep ref, values %$_; }; } } sub import { my $bail_set = 0; if ( $ENV{BAIL_ON_FAIL} ) { $bail_set = 1; bail_on_fail(); } if ( !$bail_set and $ENV{DIE_ON_FAIL} ) { die_on_fail(); } for my $i ( 0 .. $#_ ) { if ( 'bail' eq $_[$i] ) { splice @_, $i, 1; bail_on_fail(); $bail_set = 1; last; } } for my $i ( 0 .. $#_ ) { if ( !$bail_set and ( 'die' eq $_[$i] ) ) { splice @_, $i, 1; die_on_fail(); last; } } for my $i ( 0 .. $#_ ) { if ( 'defer_plan' eq $_[$i] ) { splice @_, $i, 1; my $builder = Test::Builder->new; $builder->{Have_Plan} = 1; # don't like setting this directly, but Test::Builder::has_plan doe $builder->{TEST_MOST_deferred_plan} = 1; $builder->{TEST_MOST_all_done} = 0; last; } } # 'magic' goto to avoid updating the callstack goto &Test::Builder::Module::import; } sub explain { return unless $ENV{TEST_VERBOSE}; Test::More::diag( map { ref $_ ? do { require Data::Dumper; local $Data::Dumper::Indent = 1; local $Data::Dumper::Sortkeys = 1; local $Data::Dumper::Terse = 1; Data::Dumper::Dumper($_); } : $_ } @_ ); } sub die_on_fail { _set_failure_handler( sub { die "Test failed. Stopping test.\n" } ); } sub bail_on_fail { _set_failure_handler( sub { Test::More::BAIL_OUT("Test failed. BAIL OUT!.\n") } ); } sub restore_fail { no warnings 'redefine'; *Test::Builder::ok = $OK_FUNC; } sub all_done { my $builder = Test::Builder->new; if ($builder->{TEST_MOST_deferred_plan}) { $builder->{TEST_MOST_all_done} = 1; $builder->expected_tests(@_ ? $_[0] : $builder->current_test); } } sub _set_failure_handler { my $action = shift; no warnings 'redefine'; Test::Builder->new->{TEST_MOST_failure_action} = $action; # for DESTROY *Test::Builder::ok = sub { local $Test::Builder::Level = $Test::Builder::Level + 1; my $builder = $_[0]; if ( $builder->{TEST_MOST_test_failed} ) { $builder->{TEST_MOST_test_failed} = 0; $action->(); } $builder->{TEST_MOST_test_failed} = 0; my $result = $OK_FUNC->(@_); $builder->{TEST_MOST_test_failed} = !( $builder->summary )[-1]; return $result; }; } { no warnings 'redefine'; # we need this because if the failure is on the final test, we won't have # a subsequent test triggering the behavior. sub Test::Builder::DESTROY { my $builder = $_[0]; if ( $builder->{TEST_MOST_test_failed} ) { $builder->{TEST_MOST_failure_action}->(); } } } sub _deferred_plan_handler { my $builder = Test::Builder->new; if ($builder->{TEST_MOST_deferred_plan} and !$builder->{TEST_MOST_all_done}) { $builder->expected_tests($builder->current_test + 1); } } # This should work because the END block defined by Test::Builder should be # guaranteed to be run before t one, since we use'd Test::Builder way up top. # The other two alternatives would be either to replace Test::Builder::_ending # similar to how we did Test::Builder::ok, or to call Test::Builder::no_ending # and basically rewrite _ending in our own image. Neither is very palatable, # considering _ending's initial underscore. END { _deferred_plan_handler(); } 1; =head1 AUTHOR Curtis Poe, C<< >> =head1 BUGS Please report any bugs or feature requests to C, or through the web interface at L. I will be notified, and then you'll automatically be notified of progress on your bug as I make changes. =head1 SUPPORT You can find documentation for this module with the perldoc command. perldoc Test::Most You can also look for information at: =over 4 =item * RT: CPAN's request tracker L =item * AnnoCPAN: Annotated CPAN documentation L =item * CPAN Ratings L =item * Search CPAN L =back =head1 TODO =head2 Deferred plans Sometimes you don't know the number of tests you will run when you use C. The C function allows you to delay specifying the plan, but you must still call it before the tests are run. This is an error: use Test::More; my $tests = 0; foreach my $test ( my $count = run($test); # assumes tests are being run $tests += $count; } plan($tests); The way around this is typically to use 'no_plan' and when the tests are done, C merely sets the plan to the number of tests run. We'd like for the programmer to specify this number instead of letting C do it. However, C internals are a bit difficult to work with, so we're delaying this feature. =head2 Cleaner skip() if ( $some_condition ) { skip $message, $num_tests; } else { # run those tests } That would be cleaner and I might add it if enough people want it. =head1 CAVEATS Because of how Perl handles arguments, and because diagnostics are not really part of the Test Anything Protocol, what actually happens internally is that we note that a test has failed and we die or bail out as soon as the I test is called (but before it runs). This means that its arguments are automatically evaulated before we can take action: use Test::Most qw; ok $foo, 'Die if this fails'; ok factorial(123456), '... but wait a loooong time before you die'; =head1 ACKNOWLEDGEMENTS Many thanks to C for arguing about this so much that I just went ahead and did it :) Thanks to Aristotle for suggesting a better way to die or bailout. Thanks to 'swillert' (L) for suggesting a better implementation of my "dumper explain" idea (L). =head1 COPYRIGHT & LICENSE Copyright 2008 Curtis Poe, all rights reserved. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. =cut 1;