Inspect PFTT2 console options #13

New Issue

admin · 2026-01-24T11:40:10+01:00

admin commented

2026-01-24 11:40:10 +01:00

Originally created by @weltling on GitHub (Mar 29, 2019).

The options shown by bin\pftt help need to be inspected. The goal is to evaluate, which options work, which don't. Please put the findings in this issue. A further decision for every option should be made, whether it needs to be supported or removed.

Thanks.

Originally created by @weltling on GitHub (Mar 29, 2019). The options shown by `bin\pftt help` need to be inspected. The goal is to evaluate, which options work, which don't. Please put the findings in this issue. A further decision for every option should be made, whether it needs to be supported or removed. Thanks.

admin commented

2026-01-24 11:40:10 +01:00

@lavturo commented on GitHub (Aug 13, 2019):

This was something I worked on previous, figured I should finish at least testing each command. We can come back to this later as there are other tasks that should prioritized more. Here's the whole list:

Options that work:
core_named
core_list
help
info
smoke (Works but fails for TS builds)
-config
report (Only when comparing 2 result packs)
parse (Runs, but unsure if it runs correctly)
setup (Setups requirements to run PHP builds only (afaik))
stop (Works, unsure if it is supposed to do more)
-skip_smoke_tests
-randomize_order
-thread_count (Works when there is number)
-no_thread_safety (Seems to work, can't tell for sure)
-run_count
-suspend_seconds (Had to install and then seems to work)
-ini_actual_all (Seems to work)
-ignore_output (Believe it works, a lot more fails occur though)
-run_test_times_all
-run_test_times_list
-run_group_times_all (Runs but maybe not as intended)
-run_group_times_list
-skip_name
-skip_list
-max_test_read_count
-pause
-results_only (Shows only test result, no summary of test results at end)
-phpt_not_in_place
-overwrite

Options that do not work:
core_all (COM class not found)
app_all (source-test-pack not found (might work if we have it))
app_named
app_list
ui_all (Selenium error)
ui_named
ui_list
run-test (Does not seem to work or input requirements are unclear)
perf (Does not seem to work or is not enabled)
release_list (No signature method)
release_get (Is not able to find builds/test packs and no signature method (for some))
open (Runs, but does not work (input line line too long))
-q (Maybe not enabled. Pass, skip, xskip files still have all results)
-mem_check
-run_test_pack (Runs 1 time then gets stuck next run through)
-gui (GUI pops up but many functions don't work and gets stuck at the end)

Not able to tell:
-restart_each_test_all (Probably used with app commands)
-no_restart_all
-max_run_time_millis (Probably used with app commands)
-dont_cleanup_test_pack (Currently does not do anything. Maybe commented out?)
-pftt_debug
-bo (Cannot tell because release_get does not work (build only))
-tpo (Cannot tell because release_get does not work (test pack only))
-dpo (Cannot tell because release_get does not work (debug-pack only))
-uac (Opens a new window and runs tests there. Can't confirm if cmd is elevated)
-disable_debug_prompt
-auto (Can't confirm because of previous 2 commands (-uac, -diable_debug_prompt))
-debug_all (Quickly opens another window, then closes.)
-debugger
-debug_name
-debug_list
-src_pack
-debug_pack

@lavturo commented on GitHub (Aug 13, 2019): This was something I worked on previous, figured I should finish at least testing each command. We can come back to this later as there are other tasks that should prioritized more. Here's the whole list: **Options that work:** core_named core_list help info smoke (Works but fails for TS builds) -config report (Only when comparing 2 result packs) parse (Runs, but unsure if it runs correctly) setup (Setups requirements to run PHP builds only (afaik)) stop (Works, unsure if it is supposed to do more) -skip_smoke_tests -randomize_order -thread_count (Works when there is number) -no_thread_safety (Seems to work, can't tell for sure) -run_count -suspend_seconds (Had to install and then seems to work) -ini_actual_all (Seems to work) -ignore_output (Believe it works, a lot more fails occur though) -run_test_times_all -run_test_times_list -run_group_times_all (Runs but maybe not as intended) -run_group_times_list -skip_name -skip_list -max_test_read_count -pause -results_only (Shows only test result, no summary of test results at end) -phpt_not_in_place -overwrite **Options that do not work:** core_all (COM class not found) app_all (source-test-pack not found (might work if we have it)) app_named app_list ui_all (Selenium error) ui_named ui_list run-test (Does not seem to work or input requirements are unclear) perf (Does not seem to work or is not enabled) release_list (No signature method) release_get (Is not able to find builds/test packs and no signature method (for some)) open (Runs, but does not work (input line line too long)) -q (Maybe not enabled. Pass, skip, xskip files still have all results) -mem_check -run_test_pack (Runs 1 time then gets stuck next run through) -gui (GUI pops up but many functions don't work and gets stuck at the end) **Not able to tell:** -restart_each_test_all (Probably used with app commands) -no_restart_all -max_run_time_millis (Probably used with app commands) -dont_cleanup_test_pack (Currently does not do anything. Maybe commented out?) -pftt_debug -bo (Cannot tell because release_get does not work (build only)) -tpo (Cannot tell because release_get does not work (test pack only)) -dpo (Cannot tell because release_get does not work (debug-pack only)) -uac (Opens a new window and runs tests there. Can't confirm if cmd is elevated) -disable_debug_prompt -auto (Can't confirm because of previous 2 commands (-uac, -diable_debug_prompt)) -debug_all (Quickly opens another window, then closes.) -debugger -debug_name -debug_list -src_pack -debug_pack

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: php/pftt2#13