2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | # Copyright 2020 H2O.ai; Proprietary License; -*- encoding: utf-8 -*- 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | ------------------------------------------------------------------------------- 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | H2O DRIVERLESS AI EXPERIMENT LOGFILE 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | PROPRIETARY LICENSE - 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | USE OF ANY PART OF THIS SOFTWARE REQUIRES A VALID, 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | ONGOING LICENSE AGREEMENT WITH H2O.AI. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | Please contact sales@h2o.ai for more information. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | ------------------------------------------------------------------------------- 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | H2O.AI 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | END USER SOFTWARE LICENSE AGREEMENT 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | (Last Updated: March 26, 2020) 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | IMPORTANT: PLEASE READ BEFORE INSTALLATION OR USE OF THE H2O.AI (“LICENSOR”) SOFTWARE. YOU HAVE PURCHASED A LICENSE TO (“SOFTWARE”). BY INSTALLING OR IN ANY WAY USING THE SOFTWARE, THE ENTITY OR COMPANY THAT YOU REPRESENT ("LICENSEE") IS UNCONDITIONALLY CONSENTING TO BE BOUND BY AND IS BECOMING A PARTY TO THIS LICENSE AGREEMENT ("AGREEMENT") WITH LICENSOR. IF LICENSEE DOES NOT UNCONDITIONALLY AGREE TO ALL OF THE TERMS OF THIS AGREEMENT, INSTALLATION OR USE SOFTWARE IS STRICTLY PROHIBITED. IF THESE TERMS ARE CONSIDERED AN OFFER, ACCEPTANCE IS EXPRESSLY LIMITED TO THESE TERMS. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | IN THE EVENT THERE IS A SEPARATELY NEGOTIATED AND EXECUTED MASTER SERVICES AGREEMENT BETWEEN LICENSOR AND LICENSEE WITH RESPECT TO PROCUREMENT OF THE SOFTWARE, SUCH AGREEMENT SHALL CONTROL AND THIS AGREEMENT WILL NOT APPLY. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 1. LICENSE GRANT. Subject to the terms of this Agreement, Licensor hereby grants Licensee a limited, personal, non-sublicensable, non-transferable, nonexclusive license to use the Software (in object code form only) only for Licensee’s internal use for the purpose for which it is provided and only in accordance with any Licensor-provided documentation (including as provided electronically). The Software may be accessed by the number of users agreed to by the Licensor and Licensee during the purchase process (e.g. on an order form). Such users will be specific individuals named by Licensee during the purchase process, or subsequently, in writing (email is sufficient). Once such named individuals are selected by Licensee – they may be changed only on written notice to Licensor (email is sufficient). The named individuals will not allow any other Licensee personnel to use their Software log-in credentials (passwords, etc.). No source code will be provided. To the extent the Software is provided for no charge or on an evaluation basis (in either case, “Evaluation Basis”), this Agreement may be terminated by Licensor at any time, for any or no reason, on five (5) days written notice. Licensee acknowledges that other sections of this Agreement contain terms and conditions specific to services provided on an Evaluation Basis. In the event Licensee purchases additional modules or add-ons to Software (including, without limitation, any features or functions that H2O charges other customers for), they will be deemed “Software” and, therefore, subject to this Agreement (unless Licensor provides them pursuant to different terms and conditions). With respect to any Licensee proposed modifications, derivatives, enhancements or improvements to the Software (“Feedback”), Licensee hereby grants H2O.ai a perpetual, irrevocable, royalty free, fully paid-up, sub-licensable, right and license to use, display, reproduce, distribute and otherwise fully exploit such Feedback for any purposes. All Feedback is provided by Licensee “AS IS”. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 1. LICENSE RESTRICTIONS. Except as expressly and unambiguously permitted by this Agreement, Licensee shall not, nor permit anyone else to, directly or indirectly: (i) copy, modify, resell or distribute the Software; (ii) reverse engineer, disassemble, decompile or otherwise attempt to discover the source code or structure, sequence and organization of the Software (except the foregoing will not apply to the extent prohibited by applicable local law); (iii) rent, lease, or use the Software for timesharing or service bureau purposes, or otherwise use the Software on behalf of any third party; (iv) use the Software to develop any other product or services whether delivered internally or as an external service offering or (v) use the Software for performing comparisons or other "benchmarking" activities, either alone or in connection with any other software (and Licensee will not publish or disclose any such performance information or comparisons). Licensee shall maintain and not remove or obscure any proprietary notices on or in the Software. As between the parties, title, ownership rights, and intellectual property rights in and to the Software, and any copies or portions thereof, shall remain in Licensor and its suppliers or licensors. Licensee understands that Licensor may modify or discontinue offering the Software at any time (provided that, if Licensee has purchased a term-based license – such discontinuance will only take place at the end of the then-current term). The Software is protected by the copyright laws and treaties. This Agreement does not give Licensee any rights not expressly granted herein. On ten (10) days notice, Licensor shall have the right to (itself or through a designated third party) audit Licensee’s facilities, networks, systems, books and records to confirm Licensee’s use of the Software is in accordance with the terms and conditions of this Agreement. Licensee will fully cooperate and assist with such audits. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2. SUPPORT AND UPGRADES. During the term of this Agreement Licensor will provide Licensee with Software support according to Licensor’s general support practices and procedures. Licensee acknowledges that the Software contains features that allow Licensor to remotely and automatically identify, track and analyze certain aspects of use and performance of Software and/or the systems on which it is installed, as well as the operator and operating environment (including problems and issues that arise in connection therewith). 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 3. FEES. To the extent the Software is procured via a reseller – and Licensee pays such reseller for the Software – Licensee will not owe fees directly to Licensor hereunder. With respect to any other procurement of the Software, Licensee shall pay Licensor (or its applicable authorized reseller) the fees (if any) for the Software as agree to by the parties in writing at the time of purchase. Such fees are payable within thirty (30) days from the date of invoice , are non-refundable and payable in US dollars. Licensee shall also pay all sales, use, value-added and other taxes, tariffs and duties of any type assessed against Licensor except for taxes on Licensor’s income. Late fees will be subject to a finance charge of the lesser of (i) 1.5% per thirty (30) day period and (ii) the greatest amount allowed by applicable law. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 4. INDEMNITY. Licensee shall indemnify and hold harmless Licensor from any claims, damages, liabilities, costs and fees (including reasonable attorney fees) arising from Licensee’s use of the Software as well as from Licensee’s negligence, willful misconduct or failure to comply with any term of this Agreement. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 5. LIMITED WARRANTY. Licensor warrants to Licensee that all Software will conform materially with the Documentation. In the event of a breach of this Section, Licensee’s sole remedy, and Licensor’s exclusive liability, shall be for H2O to use commercially reasonable efforts to correct any such defect(s); provided that, Licensee specifically notifies Licensor in writing of the defect(s) within thirty (30) days form the date Licensee first experiences the defect. Such corrections will be in accordance with Licensor’s standard practices (such as release cycles) that it provides to its other general customers. This Section 6 will not apply to Software provided on an evaluation basis (or any other no-fee basis). 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 6. WARRANTY DISCLAIMER. EXCEPT AS EXPRESSLY SET FORTH IN SECTION 6, LICENSOR AND ITS SUPPLIERS PROVIDE The SOFTWARE "AS IS" and without warranty of any kind, AND hereby disclaims all express or implied warranties, including without limitation warranties of merchantability, fitness for a particular purpose, PERFORMANCE, ACCURACY, RELIABILITY, and non-infringement. This disclaimer of warranty constitutes an essential part of this Agreement. SOME STATES DO NOT ALLOW LIMITATIONS ON HOW LONG AN IMPLIED WARRANTY LAST SO THE FOREGOING LIMITATIONS MAY NOT APPLY TO LICENSEE. NOTWITHSTANDING ANY OF THE FOREGOING (INCLUDING SECTION 6) – NO WARRANTIES OF ANY KIND ARE MADE WITH RESPECT TO SOFTWARE PROVIDED ON AN EVALUATION BASIS). 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 7. LIMITATION OF LIABILITY. UNDER NO CIRCUMSTANCES AND UNDER NO LEGAL THEORY, INCLUDING, BUT NOT LIMITED TO, TORT, CONTRACT, NEGLIGENCE, STRICT LIABILITY, OR OTHERWISE, SHALL LICENSOR OR ITS SUPPLIERS OR RESELLERS BE LIABLE TO LICENSEE OR ANY OTHER PERSON IN CONNECTION WITH THE SOFTWARE OR ANY OTHER SUBJECT MATTER OF THIS AGREEMENT FOR ANY: (I) INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES OF ANY CHARACTER INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOST PROFITS, LOSS OF GOODWILL, WORK STOPPAGE, ACCURACY OF RESULTS, COMPUTER FAILURE OR MALFUNCTION, (II) ANY AMOUNTS IN THE AGGREGATE IN EXCESS OF THE FEES PAID BY LICENSEE HEREUNDER DURING THE TWELVE (12) MONTH PERIOD PRIOR TO THE DATE THE CAUSE OF ACTION ACCRUES (BUT IF NO FEES HAVE BEEN PAID, SUCH AS FOR SOFTWARE PROVIDED ON AN EVALUATION BASIS, THE DAMAGES CAP WILL BE US$1,000.00), (III) THE COST OF PROCUREMENT OF SUBSTITUTE SOFTWARE OR (IV) MATTERS BEYOND ITS REASONABLE CONTROL. THE FOREGOING LIMITATIONS SHALL APPLY EVEN IF LICENSOR SHALL HAVE BEEN INFORMED OF THE POSSIBILITY OF SUCH DAMAGES. SOME STATES DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES, SO THE ABOVE LIMITATION AND EXCLUSION MAY NOT APPLY TO LICENSEE. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 8. TERM AND TERMINATION. This Agreement is effective as of the Effective Date and, unless otherwise agreed to by the parties in writing, will have the initial subscription term of one (1) year. Thereafter, it will automatically renew for successive renewal subscription terms of equal length to its initial subscription term, unless either party provides the other party with written notice of non-renewal at least sixty (60) days prior to the expiration of the then-current subscription term. The initial subscription term and all renewals are referred to collectively as the “Subscription Term”. Notwithstanding the foregoing, Software provided on an Evaluation Basis will, unless otherwise agreed in writing, have a term of thirty (30) days. In addition, either party may terminate this Agreement on written notice if the other party (a) fails to cure any material breach of this Agreement within thirty (30) days after written notice (ten (10) days in the case of non-payment or in the event Licensee breaches any license or use restrictions); (b) ceases operation without a successor; or (c) seeks protection under any bankruptcy, receivership, trust deed, creditors’ arrangement, composition, or comparable proceeding, or if any such proceeding is instituted against that party (and not dismissed within ninety (90) days thereafter). With respect to Customer’s breach of its payment obligations, or any license or use restrictions, electronic notice to Customer is sufficient hereunder. Any termination of this Agreement shall also terminate the licenses granted hereunder. Upon termination of this Agreement for any reason, Licensee shall destroy and remove from all computers, hard drives, networks, and other storage media all copies of the Software, and shall, if requested by Licensor, so certify to Licensor in writing that such actions have occurred. Sections 2 and 4 through 14, and all accrued rights to payment, shall survive termination of this Agreement. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 9. GOVERNMENT USE. If Licensee is part of an agency, department, or other entity of the United States Government ("Government"), the use, duplication, reproduction, release, modification, disclosure or transfer of the Software is restricted in accordance with the Federal Acquisition Regulations as applied to civilian agencies and the Defense Federal Acquisition Regulation Supplement as applied to military agencies. The Software is "commercial computer software" and "commercial computer software documentation." In accordance with such provisions, any use of the Software by the Government shall be governed solely by the terms of this Agreement. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 10. EXPORT CONTROLS. Licensee shall comply with all export laws and restrictions and regulations of the Department of Commerce, the United States Department of Treasury Office of Foreign Assets Control ("OFAC"), or other United States or foreign agency or authority, and Licensee shall not export, or allow the export or re-export of the Software in violation of any such restrictions, laws or regulations. By installing or using the Software, Licensee agrees to the foregoing and represents and warrants that Licensee is not located in, under the control of, or a national or resident of any restricted country. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 11. NOTICE. Any notice or communication required or permitted under this Agreement shall be in writing to the parties at: (i) if to Licensee, the address listed by Licensee during the Software registration process (or as otherwise provided by Licensee) and (ii) if to Licensor, H2O.ai, Inc. Attn: Contract Administration (or at such other address as may be given by Licensor at any time) - and shall be deemed to have been received by the addressee (iii) if given by hand, immediately upon receipt; (iv) if given by overnight courier service, the first business day following dispatch or (v) if given by registered or certified mail, postage prepaid and return receipt requested, the second business day after such notice is deposited in the mail. In addition, to be effective, legal notices to Licensor (such as for breach) must also be provided in email to: salesops@h2o.ai (subject heading: Attn: Legal Notice) (but, notwithstanding earlier receipt via email, legal notices will be deemed received when the physical notice is received as set forth in preceding sentence). Notwithstanding the foregoing, an electronic notice to Licensee (such as via email) is sufficient to the extent related to breach or termination. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 12. LOGO USAGE. During the term of this Agreement and for a reasonable wind-down period thereafter, Licensor may use Licensee’s name and logo on its website and in marketing materials as part of a general list of customers. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 13. MISCELLANEOUS. Licensor shall have the right to inspect and audit Licensee’s facilities to confirm Licensee’s compliance with this Agreement. This Agreement represents the complete agreement concerning the Software between the parties, to the exclusion of any pre-printed or contrary terms of any Licensee purchase order (or similar document), and supersedes all prior agreements and representations between them; provided, however, that if there is already a mutually signed agreement between Licensor and Licensee (not including any Licensee purchase order or similar document) covering Licensee’s purchase of a license to use the Software, then the express terms of that signed agreement will govern to the extent they are expressly contrary to this Agreement. This Agreement may be amended only by a writing executed by both parties. If any provision of this Agreement is held to be unenforceable for any reason, such provision shall be reformed only to the extent necessary to make it enforceable. The failure of Licensor to act with respect to a breach of this Agreement by Licensee or others does not constitute a waiver and shall not limit Licensor’s rights with respect to such breach or any subsequent breaches. This Agreement is personal to Licensee and may not be assigned or transferred for any reason whatsoever without Licensor’s consent and any action or conduct in violation of the foregoing shall be void and without effect. Licensor expressly reserves the right to assign this Agreement and to delegate any of its obligations hereunder. This Agreement shall be governed by and construed under California law as such law applies to agreements between California residents entered into and to be performed within California, without regard to the Uniform Computer Information Transactions Act. Without limiting Company’s right to seek injunctive or other equitable relief in court, either party may elect (by written notice given prior filing a complaint or, in the case of the defendant, prior to answering a complaint) to resolve a dispute by binding arbitration in the English language in San Francisco, California under the Rules and Procedures of the Judicial Arbitration and Mediation Service, Inc.; the decision of the arbitrator will be enforceable in any court. The JAMS Streamlined Rules will be used if available. Subject to the foregoing, all disputes will be subject to the sole and exclusive jurisdiction of, and venue in, the state and federal courts located in San Francisco, California. The party prevailing in any dispute under this Agreement shall be entitled to its costs and legal fees. 2021-08-20 00:48:40,834 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Python version: 3.8.5 (default, Sep 4 2020, 07:30:14) 2021-08-20 00:48:40,836 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | [GCC 7.3.0] 2021-08-20 00:48:40,838 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Current locale: en_US.UTF-8 2021-08-20 00:48:40,840 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Build version: 4d0fa399cc29d558c62ec11a55d326d1036c08e7 2021-08-20 00:48:40,841 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Set for no core dumps 2021-08-20 00:48:40,878 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Physical device for temporary directory: /dev/sda2 2021-08-20 00:48:41,076 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | h2oaicore hashes: wheel=4d0fa399cc29d558c62ec11a55d326d1036c08e7 git= jen=None 2021-08-20 00:48:41,078 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:41,089 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Driverless AI Config Settings 2021-08-20 00:48:41,091 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Modify config.toml or set DRIVERLESS_AI_= to override (double-quote arrays) 2021-08-20 00:48:41,094 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:41,096 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | abs_tol_for_perfect_score : 0.0001 2021-08-20 00:48:41,099 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | acceptance_test_timeout : 20.0 2021-08-20 00:48:41,101 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | acceptance_tests_max_number_of_parameter_combinations : 20 2021-08-20 00:48:41,105 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | additional_authentication_methods : [] 2021-08-20 00:48:41,109 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | agg_funcs_for_group_by : ['mean', 'sd', 'min', 'max', 'count'] 2021-08-20 00:48:41,112 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_any_call_to_skip_failures : True 2021-08-20 00:48:41,115 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_change_layer_count_brain : False 2021-08-20 00:48:41,117 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_concurrent_sessions : True 2021-08-20 00:48:41,120 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_config_overrides_in_expert_page : True 2021-08-20 00:48:41,124 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_debug_context : True 2021-08-20 00:48:41,127 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_different_classes_across_fold_splits : True 2021-08-20 00:48:41,129 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_form_autocomplete : True 2021-08-20 00:48:41,132 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_localstorage : True 2021-08-20 00:48:41,135 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_non_dai_dask_cluster_for_testing : False 2021-08-20 00:48:41,138 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_old_recipes_use_datadir_as_data_directory : True 2021-08-20 00:48:41,142 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_orig_cols_in_predictions : True 2021-08-20 00:48:41,145 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_reduce_features_when_failure : auto 2021-08-20 00:48:41,148 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_version_change_user_packages : False 2021-08-20 00:48:41,151 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_introspection_enabled : False 2021-08-20 00:48:41,154 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_introspection_method : OAUTH2_TOKEN_INTROSPECTION 2021-08-20 00:48:41,157 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_oauth2_scopes : 2021-08-20 00:48:41,160 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_oauth2_username_field_name : username 2021-08-20 00:48:41,163 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | app_language : en 2021-08-20 00:48:41,166 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | apply_featuregene_limits_after_tuning : True 2021-08-20 00:48:41,169 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_file_system_directory : tmp 2021-08-20 00:48:41,172 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_branch : dev 2021-08-20 00:48:41,174 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_repo : 2021-08-20 00:48:41,177 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_ssh_private_key_file_location : 2021-08-20 00:48:41,179 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_user : git 2021-08-20 00:48:41,182 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_s3_bucket : 2021-08-20 00:48:41,185 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_store : file_system 2021-08-20 00:48:41,188 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | assumed_simultaneous_dt_forks_munging : 3 2021-08-20 00:48:41,190 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | assumed_simultaneous_dt_forks_stats_openblas : 1 2021-08-20 00:48:41,193 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_algorithm : HS256 2021-08-20 00:48:41,195 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_cookie_name : 2021-08-20 00:48:41,198 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_exp_leeway_seconds : 0 2021-08-20 00:48:41,200 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_header_name : 2021-08-20 00:48:41,203 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_required_audience : 2021-08-20 00:48:41,205 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_required_issuer : 2021-08-20 00:48:41,208 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_source_parse_regexp : (?P.*) 2021-08-20 00:48:41,210 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_token_source : HEADER 2021-08-20 00:48:41,213 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_username_claim_name : sub 2021-08-20 00:48:41,215 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_verify : True 2021-08-20 00:48:41,218 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_access_token_expiry_key : expires_in 2021-08-20 00:48:41,220 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_auth_uri : 2021-08-20 00:48:41,223 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_configuration_uri : 2021-08-20 00:48:41,225 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_default_scopes : 2021-08-20 00:48:41,228 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_end_session_endpoint_url : 2021-08-20 00:48:41,231 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_grant_type : 2021-08-20 00:48:41,233 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_logout_uri : 2021-08-20 00:48:41,236 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_provider_base_uri : 2021-08-20 00:48:41,238 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_redirect_uri : 2021-08-20 00:48:41,241 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_refresh_token_expiry_key : refresh_expires_in 2021-08-20 00:48:41,243 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_response_type : 2021-08-20 00:48:41,245 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_scope : 2021-08-20 00:48:41,249 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_token_expiration_secs : 3600 2021-08-20 00:48:41,252 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_token_introspection_url : 2021-08-20 00:48:41,255 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_token_uri : 2021-08-20 00:48:41,257 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_urlencode_quote_via : quote 2021-08-20 00:48:41,260 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_use_objectpath_expression : 2021-08-20 00:48:41,262 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_use_objectpath_match : False 2021-08-20 00:48:41,265 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_userinfo_uri : 2021-08-20 00:48:41,267 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_crl_file : 2021-08-20 00:48:41,269 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_field_parse_regexp : (?P.*) 2021-08-20 00:48:41,274 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_authorization_lookup_filter : 2021-08-20 00:48:41,276 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_authorization_search_base : 2021-08-20 00:48:41,279 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_bind_dn : 2021-08-20 00:48:41,281 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_port : 2021-08-20 00:48:41,284 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_search_base : 2021-08-20 00:48:41,286 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_search_filter : 2021-08-20 00:48:41,289 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_server : 2021-08-20 00:48:41,291 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_tls_file : 2021-08-20 00:48:41,294 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_use_ssl : False 2021-08-20 00:48:41,296 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_username_attribute : 2021-08-20 00:48:41,300 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_subject_field : CN 2021-08-20 00:48:41,303 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_user_lookup : REGEXP_ONLY 2021-08-20 00:48:41,306 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | authentication_default_timeout_hours : 72.0 2021-08-20 00:48:41,308 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | authentication_gui_polling_prolongs_session : False 2021-08-20 00:48:41,310 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | authentication_method : unvalidated 2021-08-20 00:48:41,313 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodl_stall_kill_segv : True 2021-08-20 00:48:41,315 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodl_stall_sigusr1 : True 2021-08-20 00:48:41,318 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_additional_template_folder : 2021-08-20 00:48:41,320 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_appendix_results_table : False 2021-08-20 00:48:41,323 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_classes : 9 2021-08-20 00:48:41,325 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_coef : 50 2021-08-20 00:48:41,328 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_folds : -1 2021-08-20 00:48:41,330 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_models : 1 2021-08-20 00:48:41,333 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_data_summary_col_num : -1 2021-08-20 00:48:41,336 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_enable_shapley_values : True 2021-08-20 00:48:41,338 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_feature_importance_num_perm : 1 2021-08-20 00:48:41,341 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_feature_importance_scorer : 2021-08-20 00:48:41,343 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_full_architecture_in_appendix : False 2021-08-20 00:48:41,347 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_gini_plot : False 2021-08-20 00:48:41,350 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_global_klime_num_features : 10 2021-08-20 00:48:41,352 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_global_klime_num_tables : 1 2021-08-20 00:48:41,355 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_include_permutation_feature_importance : False 2021-08-20 00:48:41,357 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_keras_summary_line_length : -1 2021-08-20 00:48:41,360 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_list_all_config_settings : False 2021-08-20 00:48:41,365 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_max_cm_size : 10 2021-08-20 00:48:41,368 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_min_relative_importance : 0.003 2021-08-20 00:48:41,372 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_num_features : 50 2021-08-20 00:48:41,374 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_num_histogram_plots : 10 2021-08-20 00:48:41,377 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_num_rows : 0 2021-08-20 00:48:41,379 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_out_of_range : 3 2021-08-20 00:48:41,382 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_output_type : docx 2021-08-20 00:48:41,384 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_pd_max_rows : 10000 2021-08-20 00:48:41,387 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_pd_max_runtime : 45 2021-08-20 00:48:41,389 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_population_stability_index : False 2021-08-20 00:48:41,392 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_population_stability_index_n_quantiles : 10 2021-08-20 00:48:41,395 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_prediction_stats : False 2021-08-20 00:48:41,398 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_prediction_stats_n_quantiles : 20 2021-08-20 00:48:41,402 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_report_name : report 2021-08-20 00:48:41,405 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_response_rate : False 2021-08-20 00:48:41,408 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_response_rate_n_quantiles : 10 2021-08-20 00:48:41,412 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_subtemplate_type : auto 2021-08-20 00:48:41,415 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_template : 2021-08-20 00:48:41,418 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_transformer_architecture_max_lines : 30 2021-08-20 00:48:41,421 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autoviz_max_aggregated_rows : 500 2021-08-20 00:48:41,424 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autoviz_max_num_columns : 50 2021-08-20 00:48:41,427 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aux_threshold_data_size_large : 10000000 2021-08-20 00:48:41,431 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_default_region : 2021-08-20 00:48:41,434 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_role_arn : 2021-08-20 00:48:41,436 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_s3_endpoint_url : 2021-08-20 00:48:41,439 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_use_ec2_role_credentials : False 2021-08-20 00:48:41,441 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_ad_auth_uri : 2021-08-20 00:48:41,444 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_ad_client_id : 2021-08-20 00:48:41,446 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_ad_scopes : [] 2021-08-20 00:48:41,449 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_init_path : https:// 2021-08-20 00:48:41,452 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_keycloak_aad_auth_uri : 2021-08-20 00:48:41,454 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_keycloak_aad_client_id : 2021-08-20 00:48:41,457 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_keycloak_broker_token_endpoint : 2021-08-20 00:48:41,459 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_use_access_token : False 2021-08-20 00:48:41,462 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_use_access_token_scopes : https://storage.azure.com/.default 2021-08-20 00:48:41,465 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_use_access_token_source : SESSION 2021-08-20 00:48:41,468 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_enable_token_auth_aad : False 2021-08-20 00:48:41,470 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_keycloak_idp_token_endpoint : 2021-08-20 00:48:41,472 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | batch_cpu_tuning_max_workers : 0 2021-08-20 00:48:41,475 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benchmark_mojo_latency : auto 2021-08-20 00:48:41,478 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benchmark_mojo_latency_auto_size_limit : 500 2021-08-20 00:48:41,480 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benford_mad_threshold_int : 0.03 2021-08-20 00:48:41,483 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benford_mad_threshold_real : 0.1 2021-08-20 00:48:41,485 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bert_migration_timeout_secs : 600 2021-08-20 00:48:41,487 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bitbucket_skip_cert_verification : False 2021-08-20 00:48:41,490 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bitbucket_tmp_relative_dir : local_git_tmp 2021-08-20 00:48:41,492 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | booster_for_fs_permute : auto 2021-08-20 00:48:41,495 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bootstrap_final_seed : -1 2021-08-20 00:48:41,497 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bootstrap_ladder_samples_limit : 10 2021-08-20 00:48:41,500 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_add_features_for_new_columns : True 2021-08-20 00:48:41,502 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_food_full : False 2021-08-20 00:48:41,505 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_inconsistent_asserts : False 2021-08-20 00:48:41,511 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_max_size_GB : 20 2021-08-20 00:48:41,513 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_maximum_diff_score : 0.1 2021-08-20 00:48:41,516 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_meta_info : False 2021-08-20 00:48:41,521 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_rel_dir : H2O.ai_brain 2021-08-20 00:48:41,523 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | can_skip_final_upper_layer_failures : True 2021-08-20 00:48:41,526 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_1_vs_N : False 2021-08-20 00:48:41,528 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_clinfo_timeout_per_gpu : 20 2021-08-20 00:48:41,531 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_clinfo_trials : 3 2021-08-20 00:48:41,536 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_distribution_shift : auto 2021-08-20 00:48:41,539 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_distribution_shift_drop : auto 2021-08-20 00:48:41,542 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_graphviz_timeout : 60 2021-08-20 00:48:41,544 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_java_timeout : 30 2021-08-20 00:48:41,547 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_leakage : auto 2021-08-20 00:48:41,549 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_pred_contribs_sum : True 2021-08-20 00:48:41,553 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_system : True 2021-08-20 00:48:41,555 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | clinfo_exit_if_fails : True 2021-08-20 00:48:41,558 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | collect_server_logs_in_experiment_logs : False 2021-08-20 00:48:41,560 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cols_to_drop : 2021-08-20 00:48:41,562 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cols_to_group_by : 2021-08-20 00:48:41,565 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | columns_count_interpretable : 200 2021-08-20 00:48:41,570 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | compute_correlation : False 2021-08-20 00:48:41,572 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | config_overrides : 2021-08-20 00:48:41,575 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | contrib_env_relative_directory : contrib/env 2021-08-20 00:48:41,577 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | contrib_relative_directory : contrib 2021-08-20 00:48:41,579 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | contrib_reload_and_recheck_server_start : True 2021-08-20 00:48:41,582 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_gpu_stall_max_count : 10 2021-08-20 00:48:41,584 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_max_workers : 0 2021-08-20 00:48:41,587 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_percent_check_period_gpulock_stalled : 1.0 2021-08-20 00:48:41,589 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_percent_check_period_stalled : 0.3 2021-08-20 00:48:41,592 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_percent_per_experiment_check_period_logging : 0.1 2021-08-20 00:48:41,596 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_stall_max_factor_interval : 20 2021-08-20 00:48:41,598 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cross_validate_meta_learner : False 2021-08-20 00:48:41,601 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cross_validate_single_final_model : True 2021-08-20 00:48:41,603 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cuml_shapley_as_imp_min_sample_size_threshold : 30 2021-08-20 00:48:41,607 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cuml_shapley_as_imp_sample_size : 100 2021-08-20 00:48:41,609 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cupy_check_import : True 2021-08-20 00:48:41,612 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_excluded_filenames_from_repo_download : [] 2021-08-20 00:48:41,614 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_git_branch : None 2021-08-20 00:48:41,617 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_git_repo : https://github.com/h2oai/driverlessai-recipes 2021-08-20 00:48:41,619 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_lock_to_git_repo : False 2021-08-20 00:48:41,622 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_alt : 0 2021-08-20 00:48:41,625 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_average_folds_for_global_lookup : False 2021-08-20 00:48:41,627 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_cv_in_cv : True 2021-08-20 00:48:41,630 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_cv_in_cv_cvte : True 2021-08-20 00:48:41,632 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_cv_in_cv_woe : True 2021-08-20 00:48:41,636 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_debug_print : False 2021-08-20 00:48:41,639 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_gini_tol : 0.01 2021-08-20 00:48:41,641 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_max_outer_cv : 5 2021-08-20 00:48:41,644 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cluster_kwargs * : {'n_workers': 1, 'processes': True, 'threads_per_worker': 1, 'scheduler_port': 0, 'dashboard_address': ':0', 'protocol': 'tcp'} 2021-08-20 00:48:41,646 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_cluster_kwargs * : {'scheduler_port': 0, 'dashboard_address': ':0', 'protocol': 'tcp'} 2021-08-20 00:48:41,649 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_dashboard_port : 8791 2021-08-20 00:48:41,651 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_protocol : tcp 2021-08-20 00:48:41,654 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_scheduler_env * : {} 2021-08-20 00:48:41,656 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_scheduler_options : 2021-08-20 00:48:41,658 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_server_port : 8790 2021-08-20 00:48:41,661 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_worker_env * : {} 2021-08-20 00:48:41,664 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_worker_nthreads : -2 2021-08-20 00:48:41,667 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_worker_options : --memory-limit 0.95 2021-08-20 00:48:41,669 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_dashboard_port : 8787 2021-08-20 00:48:41,671 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_protocol : tcp 2021-08-20 00:48:41,674 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_retrials_allreduce_empty_issue : 5 2021-08-20 00:48:41,676 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_scheduler_env * : {} 2021-08-20 00:48:41,679 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_scheduler_options : 2021-08-20 00:48:41,682 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_server_ip * : 192.168.254.2 2021-08-20 00:48:41,685 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_server_port : 8786 2021-08-20 00:48:41,689 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_env * : {'NCCL_P2P_DISABLE': '1', 'NCCL_DEBUG': 'WARN'} 2021-08-20 00:48:41,692 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_nprocs : 1 2021-08-20 00:48:41,694 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_nthreads : 1 2021-08-20 00:48:41,697 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_options : --memory-limit 0.95 2021-08-20 00:48:41,699 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_import_ignore_file_names : ['_SUCCESS'] 2021-08-20 00:48:41,702 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_ingest_timeout : 86400.0 2021-08-20 00:48:41,704 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_precision : float32 2021-08-20 00:48:41,707 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_recipe_isolate : True 2021-08-20 00:48:41,710 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_recipe_preview_num_rows : 20 2021-08-20 00:48:41,713 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | datatable_separator : 2021-08-20 00:48:41,715 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dbscand_frac_gpu_mem : 0.25 2021-08-20 00:48:41,718 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_custom : False 2021-08-20 00:48:41,721 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_daimodel_level : 0 2021-08-20 00:48:41,725 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_ga : False 2021-08-20 00:48:41,728 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_ga_pickles : False 2021-08-20 00:48:41,731 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_gpu_lock : False 2021-08-20 00:48:41,734 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_gpu_lock2 : False 2021-08-20 00:48:41,736 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_h2o4gpu_level : 0 2021-08-20 00:48:41,739 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_indiv : False 2021-08-20 00:48:41,742 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_log : False 2021-08-20 00:48:41,745 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_pipeline_pickles : False 2021-08-20 00:48:41,748 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_trace : True 2021-08-20 00:48:41,750 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | decision_tree_accuracy_switch : 7 2021-08-20 00:48:41,756 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | decision_tree_interpretability_switch : 7 2021-08-20 00:48:41,759 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_booster : lightgbm 2021-08-20 00:48:41,762 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_global_isolation_pool : True 2021-08-20 00:48:41,765 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_lightgbm_max_bin : 64 2021-08-20 00:48:41,768 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_max_bin : 256 2021-08-20 00:48:41,770 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_max_feature_interaction_depth : 8 2021-08-20 00:48:41,773 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_model_class_name : LightGBMModel 2021-08-20 00:48:41,778 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | delete_model_dirs_and_files : True 2021-08-20 00:48:41,790 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | delete_preview_trans_timings : True 2021-08-20 00:48:41,793 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | deployment_aws_bucket_name : 2021-08-20 00:48:41,795 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detailed_skip_failure_messages_level : 1 2021-08-20 00:48:41,798 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detailed_tensorflow_import_error : False 2021-08-20 00:48:41,800 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detailed_traces : False 2021-08-20 00:48:41,802 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detect_features_distribution_shift_threshold_auc : 0.55 2021-08-20 00:48:41,804 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detect_features_leakage_threshold_auc : 0.95 2021-08-20 00:48:41,806 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detect_features_per_feature_leakage_threshold_auc : 0.8 2021-08-20 00:48:41,809 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | disable_core_files : False 2021-08-20 00:48:41,811 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | disablelogout : False 2021-08-20 00:48:41,816 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | disk_limit_gb : 5 2021-08-20 00:48:41,824 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | do_not_log_list : ['artifacts_git_password', 'auth_jwt_secret', 'auth_openid_client_id', 'auth_openid_client_secret', 'auth_openid_userinfo_auth_key', 'auth_openid_userinfo_auth_value', 'auth_openid_userinfo_username_key', 'auth_tls_ldap_bind_password', 'aws_access_key_id', 'aws_secret_access_key', 'azure_blob_account_key', 'azure_blob_account_name', 'azure_connection_string', 'deployment_aws_access_key_id', 'deployment_aws_secret_access_key', 'gcs_path_to_service_account_json', 'kaggle_key', 'kaggle_username', 'kdb_password', 'kdb_user', 'ldap_bind_password', 'ldap_search_password', 'local_htpasswd_file', 'main_server_minio_access_key_id', 'main_server_minio_secret_access_key', 'main_server_redis_password', 'minio_access_key_id', 'minio_endpoint_url', 'minio_secret_access_key', 'snowflake_account', 'snowflake_password', 'snowflake_url', 'snowflake_user', 'custom_recipe_security_analysis_enabled', 'custom_recipe_import_allowlist', 'custom_recipe_import_banlist', 'custom_recipe_method_call_allowlist', 'custom_recipe_method_call_banlist', 'custom_recipe_dangerous_patterns', 'azure_ad_client_secret', 'azure_blob_keycloak_aad_client_secret', 'artifacts_azure_blob_account_name', 'artifacts_azure_blob_account_key', 'artifacts_azure_connection_string'] 2021-08-20 00:48:41,829 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | drop_constant_columns : True 2021-08-20 00:48:41,834 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_constant_model_final_ensemble : True 2021-08-20 00:48:41,841 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_distribution_shift_min_features : 1 2021-08-20 00:48:41,853 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_distribution_shift_threshold_auc : 0.999 2021-08-20 00:48:41,859 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_leakage_min_features : 1 2021-08-20 00:48:41,862 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_leakage_threshold_auc : 0.999 2021-08-20 00:48:41,866 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_id_columns : True 2021-08-20 00:48:41,868 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_low_meta_weights : True 2021-08-20 00:48:41,871 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_redundant_columns_limit : 1000 2021-08-20 00:48:41,873 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_classpath : 2021-08-20 00:48:41,876 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_jvm_args : 2021-08-20 00:48:41,878 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_login_user : 2021-08-20 00:48:41,881 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_principal_user : 2021-08-20 00:48:41,883 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_auth_type : noauth 2021-08-20 00:48:41,886 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_config_path : 2021-08-20 00:48:41,889 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_init_path : dtap:// 2021-08-20 00:48:41,894 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_key_tab_path : 2021-08-20 00:48:41,896 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_keytab_path : 2021-08-20 00:48:41,900 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dummy : 0 2021-08-20 00:48:41,902 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_every_scored_indiv : True 2021-08-20 00:48:41,905 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_every_scored_indiv_feature_count : 3 2021-08-20 00:48:41,907 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_every_scored_indiv_mutation_count : 3 2021-08-20 00:48:41,910 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_separate_files : False 2021-08-20 00:48:41,912 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_trans_timings : False 2021-08-20 00:48:41,914 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_varimp_every_scored_indiv : False 2021-08-20 00:48:41,919 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | early_stopping : True 2021-08-20 00:48:41,922 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | early_stopping_per_individual : True 2021-08-20 00:48:41,924 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | early_stopping_per_individual_spread_mutations : False 2021-08-20 00:48:41,926 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_acceptance_tests : True 2021-08-20 00:48:41,929 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_advanced_features_experiment : False 2021-08-20 00:48:41,931 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_amp_for_speed : False 2021-08-20 00:48:41,934 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_artifacts_upload : False 2021-08-20 00:48:41,936 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_basic_acceptance_tests : True 2021-08-20 00:48:41,938 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_bert_model_acceptance_test : False 2021-08-20 00:48:41,941 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_bert_transformer_acceptance_test : False 2021-08-20 00:48:41,943 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_bootstrap : True 2021-08-20 00:48:41,946 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_cache_final_pipeline : False 2021-08-20 00:48:41,948 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_constant_model : auto 2021-08-20 00:48:41,951 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_datas : True 2021-08-20 00:48:41,954 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_explainers : True 2021-08-20 00:48:41,957 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_models : True 2021-08-20 00:48:41,962 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_pretransformers : True 2021-08-20 00:48:41,967 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes : True 2021-08-20 00:48:41,971 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes_from_url : True 2021-08-20 00:48:41,975 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes_from_zip : True 2021-08-20 00:48:41,980 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes_upload : True 2021-08-20 00:48:41,984 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_scorers : True 2021-08-20 00:48:41,988 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_transformers : True 2021-08-20 00:48:41,991 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_dask_cluster * : False 2021-08-20 00:48:41,995 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_dataset_downloading : True 2021-08-20 00:48:41,999 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_decision_tree : auto 2021-08-20 00:48:42,003 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_experiment_export : True 2021-08-20 00:48:42,006 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_experiment_import : True 2021-08-20 00:48:42,009 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_ftrl : auto 2021-08-20 00:48:42,013 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_genetic_algorithm : auto 2021-08-20 00:48:42,016 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_glm : auto 2021-08-20 00:48:42,019 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_glm_rapids : False 2021-08-20 00:48:42,023 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_gui_product_tour : True 2021-08-20 00:48:42,027 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_h2o4gpu_kmeans : False 2021-08-20 00:48:42,030 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_h2o4gpu_truncatedsvd : False 2021-08-20 00:48:42,033 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_h2o_recipes : True 2021-08-20 00:48:42,036 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_https : False 2021-08-20 00:48:42,039 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_hyperopt_dask : auto 2021-08-20 00:48:42,042 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_imputation : False 2021-08-20 00:48:42,045 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_isolation_forest : off 2021-08-20 00:48:42,049 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lexilabel_encoding : off 2021-08-20 00:48:42,052 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_license_manager : False 2021-08-20 00:48:42,055 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm : auto 2021-08-20 00:48:42,058 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_boosting_types : ['gbdt'] 2021-08-20 00:48:42,061 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_cat_support : False 2021-08-20 00:48:42,063 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_cuda_support : False 2021-08-20 00:48:42,067 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_dask : auto 2021-08-20 00:48:42,070 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_extra_trees : False 2021-08-20 00:48:42,073 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_hyperopt_callback : True 2021-08-20 00:48:42,075 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_import : True 2021-08-20 00:48:42,078 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_linear_tree : False 2021-08-20 00:48:42,081 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_multiclass_balancing : auto 2021-08-20 00:48:42,083 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mapr_multi_user_mode : False 2021-08-20 00:48:42,086 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_async_api : True 2021-08-20 00:48:42,089 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_keeper : True 2021-08-20 00:48:42,092 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_priority_queues : True 2021-08-20 00:48:42,095 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_sa : True 2021-08-20 00:48:42,098 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_sa_main_chart_aggregator : True 2021-08-20 00:48:42,101 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_symlinks : True 2021-08-20 00:48:42,103 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_one_hot_encoding : auto 2021-08-20 00:48:42,106 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_projects : True 2021-08-20 00:48:42,108 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_pytorch : auto 2021-08-20 00:48:42,111 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_pytorch_nlp : auto 2021-08-20 00:48:42,113 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_pytorch_tensorboard_logger : False 2021-08-20 00:48:42,115 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_cuml_models : False 2021-08-20 00:48:42,118 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_models_dask : False 2021-08-20 00:48:42,120 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_transformers : False 2021-08-20 00:48:42,124 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_transformers_dask : False 2021-08-20 00:48:42,126 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rulefit : auto 2021-08-20 00:48:42,129 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_secure_cookies : False 2021-08-20 00:48:42,131 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_strict_confict_key_check_for_brain : True 2021-08-20 00:48:42,134 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_target_encoding : auto 2021-08-20 00:48:42,136 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow : auto 2021-08-20 00:48:42,139 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_charcnn : auto 2021-08-20 00:48:42,141 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_image : on 2021-08-20 00:48:42,143 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_import : True 2021-08-20 00:48:42,147 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_nlp_accuracy_switch : 5 2021-08-20 00:48:42,150 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_textbigru : auto 2021-08-20 00:48:42,152 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_textcnn : auto 2021-08-20 00:48:42,155 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tf32_for_speed : False 2021-08-20 00:48:42,158 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_torch_import : True 2021-08-20 00:48:42,160 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_wide_rules : auto 2021-08-20 00:48:42,162 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_ws_perfmon : False 2021-08-20 00:48:42,165 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_dart : auto 2021-08-20 00:48:42,167 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_dart_dask : auto 2021-08-20 00:48:42,170 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_gbm : auto 2021-08-20 00:48:42,174 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_gbm_dask : auto 2021-08-20 00:48:42,176 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_hyperopt_callback : True 2021-08-20 00:48:42,178 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_rapids : False 2021-08-20 00:48:42,181 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_rf : auto 2021-08-20 00:48:42,183 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xsrf_protection : True 2021-08-20 00:48:42,186 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_zero_inflated_models : auto 2021-08-20 00:48:42,189 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enabled_file_systems * : ['upload', 'file', 'hdfs', 's3', 'recipe_file', 'recipe_url'] 2021-08-20 00:48:42,191 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ensemble_accuracy_switch : 5 2021-08-20 00:48:42,194 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ensemble_meta_learner : blender 2021-08-20 00:48:42,196 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_datas : [] 2021-08-20 00:48:42,199 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_genes : [] 2021-08-20 00:48:42,201 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_mli_explainers : [] 2021-08-20 00:48:42,203 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_models : [] 2021-08-20 00:48:42,206 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_scorers : [] 2021-08-20 00:48:42,208 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_transformers : [] 2021-08-20 00:48:42,211 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | exclusive_mode : safe 2021-08-20 00:48:42,213 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_anneal_factor : 0.9 2021-08-20 00:48:42,216 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_gene_anneal : True 2021-08-20 00:48:42,219 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_grow_anneal : True 2021-08-20 00:48:42,221 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_anneal : True 2021-08-20 00:48:42,224 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_anneal_factor : 0.9 2021-08-20 00:48:42,226 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_prob0 : 0.5 2021-08-20 00:48:42,229 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_prob_lowest : 0.1 2021-08-20 00:48:42,231 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_more_unused_genes : True 2021-08-20 00:48:42,234 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_prob0 : 0.5 2021-08-20 00:48:42,236 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_prob_lowest : 0.1 2021-08-20 00:48:42,239 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | expose_server_version : True 2021-08-20 00:48:42,242 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | extra_http_headers : {} 2021-08-20 00:48:42,244 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | extra_migration_custom_recipes_missing_modules : False 2021-08-20 00:48:42,246 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | extra_mutation_level : -1 2021-08-20 00:48:42,249 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | factor_rf : 1.25 2021-08-20 00:48:42,252 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fair_c_list : [1.0, 0.1, 0.5, 0.9] 2021-08-20 00:48:42,258 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fast_approx_do_one_fold_one_model : True 2021-08-20 00:48:42,261 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fast_approx_num_trees : 50 2021-08-20 00:48:42,263 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_brain_level : 2 2021-08-20 00:48:42,266 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_brain_reset_score : auto 2021-08-20 00:48:42,268 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_brain_save_every_iteration : 0 2021-08-20 00:48:42,271 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_cost_mean_interp_for_penalty : 5 2021-08-20 00:48:42,276 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_engineering_effort : -1 2021-08-20 00:48:42,282 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_engineering_effort_default : 5 2021-08-20 00:48:42,286 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_evolution_data_size : 300000000 2021-08-20 00:48:42,289 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | features_allowed_by_interpretability : {1: 10000000, 2: 10000, 3: 1000, 4: 500, 5: 300, 6: 200, 7: 150, 8: 100, 9: 80, 10: 50, 11: 50, 12: 50, 13: 50} 2021-08-20 00:48:42,292 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | features_cost_per_interp : 0.25 2021-08-20 00:48:42,295 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | features_per_gene : 1 2021-08-20 00:48:42,298 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | file_hide_data_directory : True 2021-08-20 00:48:42,301 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | file_path_filter_include : [] 2021-08-20 00:48:42,306 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | file_path_filtering_enabled : False 2021-08-20 00:48:42,309 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | files_without_extensions_expected_types : ['parquet', 'orc'] 2021-08-20 00:48:42,312 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | final_pipeline_data_size : 1000000000 2021-08-20 00:48:42,315 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | final_vs_ga_progress_factor : 5 2021-08-20 00:48:42,318 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_ensemble_level : -1 2021-08-20 00:48:42,321 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_feature_interaction_depth : 0 2021-08-20 00:48:42,324 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_feature_interaction_depth_many_inputs_generates_not_useful : 0 2021-08-20 00:48:42,327 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_fold_reps : 0 2021-08-20 00:48:42,329 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_max_nestimators : -1 2021-08-20 00:48:42,333 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_num_folds : -1 2021-08-20 00:48:42,336 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_num_folds_evolution : -1 2021-08-20 00:48:42,339 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_num_individuals : 0 2021-08-20 00:48:42,342 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_only_first_fold_model : auto 2021-08-20 00:48:42,345 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_split_seed : 0 2021-08-20 00:48:42,348 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixup_infX : True 2021-08-20 00:48:42,352 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixup_nanpreds : True 2021-08-20 00:48:42,354 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fold_balancing_repeats_times_rows : 100000000.0 2021-08-20 00:48:42,357 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fold_reps : 1 2021-08-20 00:48:42,360 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fold_scores_instability_warning_threshold : 0.25 2021-08-20 00:48:42,363 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | folds_for_group_by : 5 2021-08-20 00:48:42,366 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | force_model_restart_to_defaults : True 2021-08-20 00:48:42,369 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | force_stratified_splits_for_imbalanced_threshold_binary : 0.01 2021-08-20 00:48:42,372 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | force_use_global_isolation_pool : False 2021-08-20 00:48:42,375 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fraction_anchor_reduce_features_when_failure : 0.1 2021-08-20 00:48:42,378 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fraction_std_bootstrap_ladder_factor : 0.01 2021-08-20 00:48:42,381 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fresh_indiv_accuracy_switch : 7 2021-08-20 00:48:42,383 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_data_frac : 0.5 2021-08-20 00:48:42,386 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_data_vary_for_interpretability : 7 2021-08-20 00:48:42,389 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_interpretabilty_switch : 7 2021-08-20 00:48:42,392 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_cols_selected : 10000000 2021-08-20 00:48:42,395 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_cols_selected_simple_factor : 2 2021-08-20 00:48:42,398 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_nonnumeric_cols_selected : 200 2021-08-20 00:48:42,401 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_numeric_cols_selected : 10000000 2021-08-20 00:48:42,404 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_prune_by_genes : False 2021-08-20 00:48:42,415 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ftrl_max_interaction_terms_per_degree : 10000 2021-08-20 00:48:42,424 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | full_cv_accuracy_switch : 8 2021-08-20 00:48:42,427 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gbm_early_stopping_rounds_max : 10000000000 2021-08-20 00:48:42,430 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gbm_early_stopping_rounds_min : 1 2021-08-20 00:48:42,432 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gcs_init_path : gs:// 2021-08-20 00:48:42,435 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | get_url_data_sleep : 5 2021-08-20 00:48:42,437 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | get_url_data_trials : 5 2021-08-20 00:48:42,440 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_accuracy_switch : 5 2021-08-20 00:48:42,442 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_do_lambda_search : True 2021-08-20 00:48:42,445 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_do_lambda_search_by_eval_metric : False 2021-08-20 00:48:42,448 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_interpretability_switch : 6 2021-08-20 00:48:42,453 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_lambda_early_stopping_rounds : 4 2021-08-20 00:48:42,456 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_nan_impute_prediction_data : True 2021-08-20 00:48:42,458 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_nan_impute_training_data : False 2021-08-20 00:48:42,461 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_nan_impute_validation_data : False 2021-08-20 00:48:42,464 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_optimal_refit : True 2021-08-20 00:48:42,467 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_id_start : 0 2021-08-20 00:48:42,469 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_data_size : 0 2021-08-20 00:48:42,472 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_delay : 10.0 2021-08-20 00:48:42,478 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_min_delay : 0.0 2021-08-20 00:48:42,480 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_safety_factor : 3 2021-08-20 00:48:42,483 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_locking_free_dead : True 2021-08-20 00:48:42,485 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_locking_trust_pool_submission : True 2021-08-20 00:48:42,489 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_locking_type : global 2021-08-20 00:48:42,492 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_small_data_size : 100000 2021-08-20 00:48:42,494 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_anneal_factor : 0.5 2021-08-20 00:48:42,497 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_prob0 : 0.8 2021-08-20 00:48:42,500 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_prob_lowest : 0.05 2021-08-20 00:48:42,503 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_proboff : 0.5 2021-08-20 00:48:42,511 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gui_enable_deploy_button : True 2021-08-20 00:48:42,513 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gui_require_experiment_name : False 2021-08-20 00:48:42,516 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_mli_fraction_memory : 0.45 2021-08-20 00:48:42,519 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_mli_nthreads * : 8 2021-08-20 00:48:42,521 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_ip : None 2021-08-20 00:48:42,524 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_kwargs * : {} 2021-08-20 00:48:42,527 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_log_level : None 2021-08-20 00:48:42,530 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_max_mem_size : None 2021-08-20 00:48:42,532 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_min_mem_size : None 2021-08-20 00:48:42,535 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_name * : None 2021-08-20 00:48:42,537 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_nthreads : 8 2021-08-20 00:48:42,540 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_port * : 50361 2021-08-20 00:48:42,544 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_start_sleep : 5 2021-08-20 00:48:42,547 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_start_sleep0 : 1 2021-08-20 00:48:42,550 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_start_trials : 5 2021-08-20 00:48:42,553 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_url : None 2021-08-20 00:48:42,556 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_address : 2021-08-20 00:48:42,560 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_internal_default_project_id : 2021-08-20 00:48:42,562 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_oauth2_scopes : 2021-08-20 00:48:42,565 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_projects_enabled : False 2021-08-20 00:48:42,568 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_rpc_bytestream_deadline_seconds : 7200 2021-08-20 00:48:42,571 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_rpc_deadline_seconds : 60 2021-08-20 00:48:42,573 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_ca_path : 2021-08-20 00:48:42,578 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_cert_path : 2021-08-20 00:48:42,580 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_enabled : True 2021-08-20 00:48:42,583 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_key_path : 2021-08-20 00:48:42,585 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_classpath : 2021-08-20 00:48:42,588 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_jvm_args : 2021-08-20 00:48:42,591 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_login_user : 2021-08-20 00:48:42,593 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_principal_user : 2021-08-20 00:48:42,597 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_supported_schemes : ['hdfs://', 'maprfs://', 'swift://'] 2021-08-20 00:48:42,600 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_auth_type : noauth 2021-08-20 00:48:42,602 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_init_path : hdfs:// 2021-08-20 00:48:42,605 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_max_files_listed : 100 2021-08-20 00:48:42,608 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | heavy_imbalance_ratio_multiclass_threshold : 25 2021-08-20 00:48:42,610 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | heavy_imbalance_ratio_sampling_threshold : 25 2021-08-20 00:48:42,613 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | high_correlation_value_to_report : 0.95 2021-08-20 00:48:42,616 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hive_app_classpath : 2021-08-20 00:48:42,620 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hive_app_configs : {} 2021-08-20 00:48:42,623 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hive_app_jvm_args : -Xmx4g 2021-08-20 00:48:42,626 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | honor_datatable_precision : False 2021-08-20 00:48:42,629 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | huber_alpha_list : [0.9, 0.3, 0.5, 0.6, 0.7, 0.8, 0.1, 0.99] 2021-08-20 00:48:42,631 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hyperopt_shift_leak : False 2021-08-20 00:48:42,634 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hyperopt_shift_leak_per_column : False 2021-08-20 00:48:42,637 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ignore_package_version : [] 2021-08-20 00:48:42,640 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | image_download_timeout : 60 2021-08-20 00:48:42,643 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | image_paths_absolute : False 2021-08-20 00:48:42,645 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_ratio_multiclass_threshold : 5 2021-08-20 00:48:42,648 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_ratio_notification_threshold : 2.0 2021-08-20 00:48:42,650 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_ratio_sampling_threshold : 5 2021-08-20 00:48:42,653 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_max_multiple_data_size : 1.0 2021-08-20 00:48:42,657 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_max_number_of_bags : 10 2021-08-20 00:48:42,661 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_max_number_of_bags_feature_evolution : 3 2021-08-20 00:48:42,664 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_method : off 2021-08-20 00:48:42,666 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_number_of_bags : -1 2021-08-20 00:48:42,669 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_rank_averaging : auto 2021-08-20 00:48:42,671 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_target_minority_fraction : -1.0 2021-08-20 00:48:42,674 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_threshold_min_rows_original : 100000 2021-08-20 00:48:42,676 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | include_all_as_pretransformers_if_none_selected : False 2021-08-20 00:48:42,681 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | include_custom_recipes_by_default : False 2021-08-20 00:48:42,684 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_datas : [] 2021-08-20 00:48:42,686 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_models * : ['LightGBMModel'] 2021-08-20 00:48:42,689 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_pretransformers : [] 2021-08-20 00:48:42,694 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_scorers * : ['ACCURACY', 'AUC', 'AUCPR', 'CALINSKIHARABASZ', 'DAVIESBOULDIN', 'F05', 'F1', 'F2', 'FDR', 'FNR', 'FOR', 'FPR', 'GINI', 'LOGLOSS', 'MACROAUC', 'MACROF1', 'MACROMCC', 'MAE', 'MAPE', 'MCC', 'MER', 'MSE', 'NPV', 'PRECISION', 'R2', 'R2COD', 'RECALL', 'RMSE', 'RMSLE', 'RMSPE', 'SILHOUETTE', 'SMAPE', 'TNR', 'UNSUPERVISED'] 2021-08-20 00:48:42,696 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_transformers * : ['BERTTransformer', 'CVCatNumEncodeTransformer', 'CVTECUMLTransformer', 'CVTargetEncodeTransformer', 'CatOriginalTransformer', 'CatTransformer', 'ClusterDistCUMLDaskTransformer', 'ClusterDistCUMLTransformer', 'ClusterDistTransformer', 'ClusterIdAllNumTransformer', 'ClusterTETransformer', 'DBSCANCUMLDaskTransformer', 'DBSCANCUMLTransformer', 'DateOriginalTransformer', 'DateTimeDiffTransformer', 'DateTimeOriginalTransformer', 'DatesTransformer', 'EwmaLagsTransformer', 'FrequentTransformer', 'ImageOriginalTransformer', 'ImageVectorizerTransformer', 'InteractionsTransformer', 'IsHolidayTransformer', 'IsolationForestAnomalyAllNumericTransformer', 'IsolationForestAnomalyNumCatAllColsTransformer', 'IsolationForestAnomalyNumCatTransformer', 'IsolationForestAnomalyNumericTransformer', 'LagsAggregatesTransformer', 'LagsInteractionTransformer', 'LagsTransformer', 'LexiLabelEncoderTransformer', 'MeanTargetTransformer', 'NumCatTETransformer', 'NumToCatTETransformer', 'NumToCatWoEMonotonicTransformer', 'NumToCatWoETransformer', 'OneHotEncodingTransformer', 'OriginalTransformer', 'RawTransformer', 'StandardScalerTransformer', 'StringConcatTransformer', 'TSNECUMLTransformer', 'TextBiGRUTransformer', 'TextCNNTransformer', 'TextCharCNNTransformer', 'TextLinModelTransformer', 'TextOriginalTransformer', 'TextTransformer', 'TimeSeriesTargetEncTransformer', 'TruncSVDAllNumTransformer', 'TruncSVDCUMLDaskTransformer', 'TruncSVDCUMLTransformer', 'TruncSVDNumTransformer', 'UMAPCUMLDaskTransformer', 'UMAPCUMLTransformer', 'WeightOfEvidenceTransformer'] 2021-08-20 00:48:42,699 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | inject_mojo_for_predictions : True 2021-08-20 00:48:42,701 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_corr_threshold : 0.95 2021-08-20 00:48:42,704 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_gini_rel_improvement_threshold : 0.5 2021-08-20 00:48:42,712 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_max_pairwise_interactions : 100 2021-08-20 00:48:42,714 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_max_rows_x_cols : 200000.0 2021-08-20 00:48:42,717 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_return_limit : 5 2021-08-20 00:48:42,720 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_search_limit : 20 2021-08-20 00:48:42,722 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | isolation_forest_nestimators : 200 2021-08-20 00:48:42,725 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | jdbc_app_classpath : 2021-08-20 00:48:42,727 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | jdbc_app_configs : {} 2021-08-20 00:48:42,730 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | jdbc_app_jvm_args : -Xmx4g 2021-08-20 00:48:42,733 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kaggle_competitions : 2021-08-20 00:48:42,735 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kaggle_keep_submission : False 2021-08-20 00:48:42,738 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kaggle_timeout : 120 2021-08-20 00:48:42,740 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_app_classpath : 2021-08-20 00:48:42,744 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_app_jvm_args : 2021-08-20 00:48:42,746 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_hostname : 2021-08-20 00:48:42,749 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_port : 2021-08-20 00:48:42,752 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | keep_fraction_default : 1.0 2021-08-20 00:48:42,755 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | klime_alpha : 0.0 2021-08-20 00:48:42,758 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | klime_lambda : [1e-06, 1e-08] 2021-08-20 00:48:42,761 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | last_recipe * : auto 2021-08-20 00:48:42,763 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_base_dn : 2021-08-20 00:48:42,766 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_base_filter : 2021-08-20 00:48:42,769 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_bind_dn : 2021-08-20 00:48:42,778 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_dc : 2021-08-20 00:48:42,780 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_ou_dn : 2021-08-20 00:48:42,784 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_port : 2021-08-20 00:48:42,788 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_recipe : 0 2021-08-20 00:48:42,791 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_attributes : 2021-08-20 00:48:42,793 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_base : 2021-08-20 00:48:42,796 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_filter : 2021-08-20 00:48:42,799 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_user_id : 2021-08-20 00:48:42,801 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_server : 2021-08-20 00:48:42,804 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_tls_file : 2021-08-20 00:48:42,807 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_use_ssl : False 2021-08-20 00:48:42,810 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_user_name_attribute : 2021-08-20 00:48:42,813 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_user_prefix : 2021-08-20 00:48:42,817 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_check_reduced_features : True 2021-08-20 00:48:42,820 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_check_text : True 2021-08-20 00:48:42,823 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_key_features_varimp : 0.001 2021-08-20 00:48:42,826 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_key_features_varimp_if_no_early_stopping : 0.05 2021-08-20 00:48:42,829 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_max_bin : 256 2021-08-20 00:48:42,832 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_max_data_size : 10000000 2021-08-20 00:48:42,836 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_max_max_depth : 8 2021-08-20 00:48:42,842 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_min_max_depth : 6 2021-08-20 00:48:42,843 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_train_test_split : 0.25 2021-08-20 00:48:42,845 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_trees : 100 2021-08-20 00:48:42,848 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_address : http://127.0.0.1:9999 2021-08-20 00:48:42,851 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_dry_run_token : 2021-08-20 00:48:42,854 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_lease_duration : 3600000 2021-08-20 00:48:42,857 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_project_name : default 2021-08-20 00:48:42,860 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_ssl_certs : true 2021-08-20 00:48:42,863 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_worker_lease_duration : 21600000 2021-08-20 00:48:42,867 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_worker_startup_timeout : 3600000 2021-08-20 00:48:42,870 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_accuracy_switch : 1 2021-08-20 00:48:42,872 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_binary_metrics : ['binary', 'binary', 'auc'] 2021-08-20 00:48:42,875 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_binary_objectives : ['binary', 'xentropy'] 2021-08-20 00:48:42,878 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_interpretability_switch : 10 2021-08-20 00:48:42,882 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_listen_port : 12400 2021-08-20 00:48:42,885 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_monotone_constraints_method : intermediate 2021-08-20 00:48:42,897 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_monotone_penalty : 0.0 2021-08-20 00:48:42,900 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_multi_metrics : ['multiclass', 'multi_error'] 2021-08-20 00:48:42,904 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_reduce_on_errors_list : ['Out of Host Memory'] 2021-08-20 00:48:42,907 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_reg_metrics : ['rmse', 'mse', 'mae'] 2021-08-20 00:48:42,911 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_reg_objectives : ['mse', 'mae'] 2021-08-20 00:48:42,915 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | limit_features_by_interpretability : True 2021-08-20 00:48:42,918 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | limit_nofile : 65535 2021-08-20 00:48:42,921 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | limit_nproc : 16384 2021-08-20 00:48:42,927 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | list_files_without_extensions : False 2021-08-20 00:48:42,930 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | local_minio_port : 9001 2021-08-20 00:48:42,933 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_fit_info : True 2021-08-20 00:48:42,935 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_level : 1 2021-08-20 00:48:42,939 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_predict_info : True 2021-08-20 00:48:42,942 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_system_info_per_experiment : True 2021-08-20 00:48:42,945 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | logit_value_unseen : -100 2021-08-20 00:48:42,948 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lossguide_drop_factor : 4.0 2021-08-20 00:48:42,951 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lossguide_max_depth_extend_factor : 8.0 2021-08-20 00:48:42,954 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lowest_nonzero_varimp : 1e-30 2021-08-20 00:48:42,957 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_minio_address * : 127.0.0.1:9001 2021-08-20 00:48:42,960 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_minio_bucket * : h2oai 2021-08-20 00:48:42,964 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_minio_bucket_ping_timeout : 30 2021-08-20 00:48:42,967 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_redis_ping_timeout : 5 2021-08-20 00:48:42,970 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_autoreport : True 2021-08-20 00:48:42,973 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_mojo_scoring_pipeline : auto 2021-08-20 00:48:42,976 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_pipeline_visualization : auto 2021-08-20 00:48:42,979 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_python_scoring_pipeline : auto 2021-08-20 00:48:42,983 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | many_columns_count : 400 2021-08-20 00:48:42,986 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_abs_score_delta_train_valid : 0.0 2021-08-20 00:48:42,990 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_absolute_cardinality : 1000000 2021-08-20 00:48:42,993 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_absolute_feature_expansion : 1000 2021-08-20 00:48:42,996 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_bootstrap_sample_size_factor : 10.0 2021-08-20 00:48:43,002 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_bootstrap_samples : 100 2021-08-20 00:48:43,005 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols : 10000000 2021-08-20 00:48:43,008 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_gui_headtail : 1000 2021-08-20 00:48:43,011 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_log_headtail : 1000 2021-08-20 00:48:43,014 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_make_autoreport_automatically : 1000 2021-08-20 00:48:43,017 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_make_pipeline_visualization_automatically : 5000 2021-08-20 00:48:43,020 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_show_feature_transformer_mapping : 1000 2021-08-20 00:48:43,023 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_show_unused_features : 1000 2021-08-20 00:48:43,026 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores : 0 2021-08-20 00:48:43,028 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores_by_physical : True 2021-08-20 00:48:43,032 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores_dai : -1 2021-08-20 00:48:43,035 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores_limit : 100 2021-08-20 00:48:43,038 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_debug_description_length : 1000 2021-08-20 00:48:43,041 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_do_timeseries_split_suggestion : 1 2021-08-20 00:48:43,044 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_munging : -1 2021-08-20 00:48:43,047 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_readwrite : -1 2021-08-20 00:48:43,050 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_stats_openblas : -1 2021-08-20 00:48:43,053 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_epochs : 10 2021-08-20 00:48:43,056 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_feature_interaction_depth : -1 2021-08-20 00:48:43,059 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_features_importance : 100000 2021-08-20 00:48:43,062 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_features_importance_debug : 1000 2021-08-20 00:48:43,065 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_files_listed : 100 2021-08-20 00:48:43,068 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fit_cores : 10 2021-08-20 00:48:43,071 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fit_cores_override : 0 2021-08-20 00:48:43,074 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fold_balancing_repeats : 10 2021-08-20 00:48:43,077 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fraction_invalid_numeric : -1.0 2021-08-20 00:48:43,080 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_int_as_cat_uniques : 50 2021-08-20 00:48:43,083 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_learning_rate : 0.5 2021-08-20 00:48:43,086 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_learning_rate_final : 0.05 2021-08-20 00:48:43,099 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_bin : 256 2021-08-20 00:48:43,103 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_depth : 12 2021-08-20 00:48:43,106 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_dt_threads_munging : 4 2021-08-20 00:48:43,115 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_dt_threads_readwrite : 4 2021-08-20 00:48:43,118 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_dt_threads_stats_openblas : 8 2021-08-20 00:48:43,121 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_nestimators : 3000 2021-08-20 00:48:43,125 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_nestimators_feature_evolution_factor : 0.2 2021-08-20 00:48:43,129 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_brain_indivs : 3 2021-08-20 00:48:43,132 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_brain_indivs_from_pop : 10000 2021-08-20 00:48:43,135 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes : 200 2021-08-20 00:48:43,138 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes_client_and_gui : 10 2021-08-20 00:48:43,142 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes_compute_roc : 200 2021-08-20 00:48:43,146 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes_hard_limit : 10000 2021-08-20 00:48:43,149 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_varimp_shift_to_log : 10 2021-08-20 00:48:43,152 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_varimp_to_log : 10 2021-08-20 00:48:43,158 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_cols_selected : 10000000 2021-08-20 00:48:43,161 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_cols_selected_simple_factor : 2 2021-08-20 00:48:43,164 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_nonnumeric_cols_selected : 300 2021-08-20 00:48:43,167 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_numeric_cols_selected : 10000000 2021-08-20 00:48:43,170 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_output_features_per_transformer : 10000 2021-08-20 00:48:43,174 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_predict_cores : 0 2021-08-20 00:48:43,177 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_predict_cores_in_dai : 4 2021-08-20 00:48:43,180 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rel_score_delta_train_valid : 0.0 2021-08-20 00:48:43,184 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_relative_cardinality : 0.95 2021-08-20 00:48:43,187 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_relative_cols_mismatch_allowed : 0.5 2021-08-20 00:48:43,191 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_cm_ga : 500000 2021-08-20 00:48:43,194 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_col_stats : 1000000 2021-08-20 00:48:43,198 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_constant_model : 1000000 2021-08-20 00:48:43,201 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_cv_in_cv_gini : 100000 2021-08-20 00:48:43,205 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_blender : 1000000 2021-08-20 00:48:43,218 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_ensemble_base_model_fold_scores : 1000000 2021-08-20 00:48:43,222 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_holdout_bootstrap_score : 1000000 2021-08-20 00:48:43,233 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_holdout_score : 5000000 2021-08-20 00:48:43,237 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_roccmconf : 1000000 2021-08-20 00:48:43,240 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_train_score : 5000000 2021-08-20 00:48:43,243 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_fs : 500000 2021-08-20 00:48:43,248 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_leak : 100000 2021-08-20 00:48:43,253 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_tuning : 1000 2021-08-20 00:48:43,256 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_runtime_minutes : 1440 2021-08-20 00:48:43,259 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_runtime_minutes_until_abort : 10080 2021-08-20 00:48:43,261 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_validation_to_training_size_ratio_for_final_ensemble : 2.0 2021-08-20 00:48:43,264 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_varimp_to_save : 100 2021-08-20 00:48:43,267 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_workers : 1 2021-08-20 00:48:43,270 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_workers_fs : 0 2021-08-20 00:48:43,273 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_workers_shift_leak : 0 2021-08-20 00:48:43,277 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | memory_limit_gb : 5 2021-08-20 00:48:43,279 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | memory_ref : 137438953472 2021-08-20 00:48:43,282 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | memory_score_factor_ref : 0.2 2021-08-20 00:48:43,285 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | merge_dup_raw_features : True 2021-08-20 00:48:43,288 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | meta_weight_allowed_by_interpretability : {1: 1E-7, 2: 1E-5, 3: 1E-4, 4: 1E-3, 5: 1E-2, 6: 0.03, 7: 0.05, 8: 0.08, 9: 0.10, 10: 0.15, 11: 0.15, 12: 0.15, 13: 0.15} 2021-08-20 00:48:43,290 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | meta_weight_allowed_for_reference : 1.0 2021-08-20 00:48:43,293 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_bootstrap_sample_size_factor : 1.0 2021-08-20 00:48:43,296 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_bootstrap_samples : 1 2021-08-20 00:48:43,299 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_dai_iterations : 0 2021-08-20 00:48:43,302 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_dt_threads_final_munging : 1 2021-08-20 00:48:43,308 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_dt_threads_munging : 1 2021-08-20 00:48:43,313 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_learning_rate : 0.05 2021-08-20 00:48:43,318 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_learning_rate_final : 0.01 2021-08-20 00:48:43,323 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_max_bin : 32 2021-08-20 00:48:43,328 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_num_cores_per_gpu : 2 2021-08-20 00:48:43,333 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_num_rows : 100 2021-08-20 00:48:43,338 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_roc_sample_size : 1 2021-08-20 00:48:43,342 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_rows_per_class : 5 2021-08-20 00:48:43,346 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_rows_per_split : 5 2021-08-20 00:48:43,350 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | minio_connector_cert_location : 2021-08-20 00:48:43,355 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | minio_init_path : / 2021-08-20 00:48:43,359 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | minio_skip_cert_verification : False 2021-08-20 00:48:43,363 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | missing_values * : ['', '?', 'None', 'nan', 'NA', 'N/A', 'unknown', 'inf', '-inf', '1.7976931348623157e+308', '-1.7976931348623157e+308'] 2021-08-20 00:48:43,366 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_batch_size : 10000 2021-08-20 00:48:43,369 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_cloud_name * : H2O-MLI-DAI-20500 2021-08-20 00:48:43,372 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_custom : 2021-08-20 00:48:43,375 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_default_max_cardinality : 10 2021-08-20 00:48:43,378 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_default_min_cardinality : 2 2021-08-20 00:48:43,382 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_fast_approx : False 2021-08-20 00:48:43,386 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_sample_size : 100000 2021-08-20 00:48:43,389 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_drf_max_depth : 20 2021-08-20 00:48:43,392 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_drf_num_trees : 100 2021-08-20 00:48:43,395 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dt_nthreads : 4 2021-08-20 00:48:43,398 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_enable_mojo_scorer : True 2021-08-20 00:48:43,402 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_fast_approx : True 2021-08-20 00:48:43,405 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_ice_per_bin_strategy : False 2021-08-20 00:48:43,408 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_interpreter_status_cache_size : 1000 2021-08-20 00:48:43,411 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_l1_reg : aic 2021-08-20 00:48:43,414 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_max_runtime : 900 2021-08-20 00:48:43,417 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_nsamples : auto 2021-08-20 00:48:43,420 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_sample : True 2021-08-20 00:48:43,423 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_sample_size : 1000 2021-08-20 00:48:43,426 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_workers : 4 2021-08-20 00:48:43,429 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_lime_method : k-LIME 2021-08-20 00:48:43,432 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_max_number_cluster_vars : 6 2021-08-20 00:48:43,443 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_max_numeric_enum_cardinality : 25 2021-08-20 00:48:43,449 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_max_surrogate_retries : 5 2021-08-20 00:48:43,453 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nfolds : 3 2021-08-20 00:48:43,458 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_append_to_english_stop_words : False 2021-08-20 00:48:43,465 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_loco_max_features : -1 2021-08-20 00:48:43,470 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_max_df : 0.9 2021-08-20 00:48:43,473 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_max_ngram : 1 2021-08-20 00:48:43,484 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_min_df : 3 2021-08-20 00:48:43,487 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_min_ngram : 1 2021-08-20 00:48:43,491 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_min_token_mode : top 2021-08-20 00:48:43,494 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_sample_limit : 10000 2021-08-20 00:48:43,498 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_stop_words : english 2021-08-20 00:48:43,501 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_surrogate_tokenizer : Linear Model + TF-IDF 2021-08-20 00:48:43,504 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_surrogate_tokens : 100 2021-08-20 00:48:43,506 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_tokenizer : tfidf 2021-08-20 00:48:43,509 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_tokenizer_max_features : -1 2021-08-20 00:48:43,512 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_top_n : 20 2021-08-20 00:48:43,516 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_use_stop_words : True 2021-08-20 00:48:43,519 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_num_quantiles : 10 2021-08-20 00:48:43,522 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_pd_numcat_num_chart : True 2021-08-20 00:48:43,525 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_pd_numcat_threshold : 11 2021-08-20 00:48:43,528 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_pd_sample_size : 25000 2021-08-20 00:48:43,534 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_predict_safe : False 2021-08-20 00:48:43,538 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_qbin_count : 0 2021-08-20 00:48:43,541 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_run_kernel_explainer : False 2021-08-20 00:48:43,545 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sa_main_chart_aggregator_limit : 1000 2021-08-20 00:48:43,548 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sa_sampling_limit : 500000 2021-08-20 00:48:43,552 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample : True 2021-08-20 00:48:43,556 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_above_for_scoring : 1000000 2021-08-20 00:48:43,559 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_above_for_training : 100000 2021-08-20 00:48:43,562 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_size : 100000 2021-08-20 00:48:43,566 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_training : True 2021-08-20 00:48:43,568 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sequential_task_execution : True 2021-08-20 00:48:43,571 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_shapley_sample_size : 100000 2021-08-20 00:48:43,575 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_strict_version_check : True 2021-08-20 00:48:43,578 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_use_raw_features : True 2021-08-20 00:48:43,581 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_vars_to_pdp : 10 2021-08-20 00:48:43,585 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | model_class_name_for_fs_permute : auto 2021-08-20 00:48:43,588 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_acceptance_test_atol : 0.0 2021-08-20 00:48:43,592 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_acceptance_test_rtol : 0.0 2021-08-20 00:48:43,595 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_building_parallelism : -1 2021-08-20 00:48:43,598 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_building_timeout : 1800.0 2021-08-20 00:48:43,602 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions : auto 2021-08-20 00:48:43,605 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_batch_size : 100 2021-08-20 00:48:43,608 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_benchmark : False 2021-08-20 00:48:43,612 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_benchmark_slower_than_python_threshold : 10 2021-08-20 00:48:43,616 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_max_rows : 10000 2021-08-20 00:48:43,620 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_text : False 2021-08-20 00:48:43,625 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_tf : False 2021-08-20 00:48:43,629 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_torch : False 2021-08-20 00:48:43,634 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_mini_acceptance_test_num_rows : 15 2021-08-20 00:48:43,638 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_correlation_threshold : 0.1 2021-08-20 00:48:43,647 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_dict * : {} 2021-08-20 00:48:43,651 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_drop_low_correlation_features : False 2021-08-20 00:48:43,656 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_interpretability_switch : 7 2021-08-20 00:48:43,660 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_log_level : medium 2021-08-20 00:48:43,663 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_max_cols : 300 2021-08-20 00:48:43,667 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | munging_report_period : 10 2021-08-20 00:48:43,671 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mutation_mode : sample 2021-08-20 00:48:43,679 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mutation_rate : -1 2021-08-20 00:48:43,683 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | n_estimators_list_no_early_stopping : [50, 100, 150, 200, 250, 300] 2021-08-20 00:48:43,687 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nbins_ftrl_list : [1000000, 10000000, 100000000] 2021-08-20 00:48:43,691 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | new_mli_list_only_explainable_datasets : False 2021-08-20 00:48:43,695 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_max : -1 2021-08-20 00:48:43,698 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_max_factor : 1.0 2021-08-20 00:48:43,702 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_max_threshold : 200 2021-08-20 00:48:43,705 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_min : -1 2021-08-20 00:48:43,709 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | ngenes_max : -1 2021-08-20 00:48:43,712 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | ngenes_min : -1 2021-08-20 00:48:43,718 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | no_drop_features : False 2021-08-20 00:48:43,721 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | notify_failures : True 2021-08-20 00:48:43,725 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_actuals_vs_predicted : 100 2021-08-20 00:48:43,728 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_as_cat : True 2021-08-20 00:48:43,732 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_cpu_sockets : 1 2021-08-20 00:48:43,736 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_cpu_sockets_override : 0 2021-08-20 00:48:43,741 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_ensemble_folds : 5 2021-08-20 00:48:43,745 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_fold_ids_show : 10 2021-08-20 00:48:43,748 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_folds : 3 2021-08-20 00:48:43,757 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_for_prediction : 0 2021-08-20 00:48:43,760 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_override : -1 2021-08-20 00:48:43,763 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_per_experiment : -1 2021-08-20 00:48:43,765 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_per_hyperopt_dask : -1 2021-08-20 00:48:43,768 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_per_model : 1 2021-08-20 00:48:43,771 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_hyperopt_individuals_final : -1 2021-08-20 00:48:43,774 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_individuals : 2 2021-08-20 00:48:43,778 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_inner_hyperopt_trials_final : 0 2021-08-20 00:48:43,781 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_inner_hyperopt_trials_prefinal : 0 2021-08-20 00:48:43,784 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_pipeline_layers : 1 2021-08-20 00:48:43,788 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_rows_acceptance_test_custom_model : 100 2021-08-20 00:48:43,792 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_rows_acceptance_test_custom_transformer : 200 2021-08-20 00:48:43,795 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_transformed_features_per_pipeline_show : 10 2021-08-20 00:48:43,799 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | number_of_texts_to_cache_in_bert_transformer : -1 2021-08-20 00:48:43,802 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_authorize_url : 2021-08-20 00:48:43,805 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_client_id : 2021-08-20 00:48:43,809 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_enabled : False 2021-08-20 00:48:43,812 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_introspection_url : 2021-08-20 00:48:43,817 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_redirect_url : 2021-08-20 00:48:43,820 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_scope : openid profile ai.h2o.storage 2021-08-20 00:48:43,826 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_token_url : 2021-08-20 00:48:43,829 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | ohe_bin_list : [10, 25, 50, 75, 100] 2021-08-20 00:48:43,833 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | one_hot_encoding_cardinality_limiter : True 2021-08-20 00:48:43,837 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | one_hot_encoding_cardinality_threshold : 50 2021-08-20 00:48:43,845 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_pruner : MedianPruner 2021-08-20 00:48:43,847 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_pruner_kwargs * : {'n_startup_trials': 5, 'n_warmup_steps': 20, 'interval_steps': 20, 'percentile': 25.0, 'min_resource': 'auto', 'reduction_factor': 4, 'min_early_stopping_rate': 0, 'n_brackets': 4, 'min_early_stopping_rate_low': 0, 'upper': 1.0, 'lower': 0.0} 2021-08-20 00:48:43,849 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_sampler : TPESampler 2021-08-20 00:48:43,855 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_sampler_kwargs * : {} 2021-08-20 00:48:43,859 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | orig_features_fs_report : False 2021-08-20 00:48:43,862 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | orig_stddev_max_cols : 1000 2021-08-20 00:48:43,866 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | parameter_tuning_num_models : -1 2021-08-20 00:48:43,869 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_dart * : {} 2021-08-20 00:48:43,871 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_decision_tree * : {} 2021-08-20 00:48:43,874 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_ftrl * : {} 2021-08-20 00:48:43,877 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_gblinear * : {} 2021-08-20 00:48:43,880 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_lightgbm * : {} 2021-08-20 00:48:43,883 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_rulefit * : {} 2021-08-20 00:48:43,886 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tensorflow * : {} 2021-08-20 00:48:43,888 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_dart * : {} 2021-08-20 00:48:43,891 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_ftrl * : {} 2021-08-20 00:48:43,894 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_gblinear * : {} 2021-08-20 00:48:43,897 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_grow_policy_simple_trees : True 2021-08-20 00:48:43,900 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_lightgbm * : {} 2021-08-20 00:48:43,903 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_rulefit * : {} 2021-08-20 00:48:43,905 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_tensorflow * : {} 2021-08-20 00:48:43,909 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_xgboost * : {} 2021-08-20 00:48:43,912 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_xgboost * : {} 2021-08-20 00:48:43,915 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pass_env_to_deprecated_python_scoring : False 2021-08-20 00:48:43,917 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pdp_max_threads : -1 2021-08-20 00:48:43,920 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | per_user_directories : True 2021-08-20 00:48:43,924 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | performance_threshold_data_size_large : 100000000 2021-08-20 00:48:43,927 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | performance_threshold_data_size_small : 100000 2021-08-20 00:48:43,930 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | perturb_xgb_depth_max : 10 2021-08-20 00:48:43,933 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | perturb_xgb_depth_min : 3 2021-08-20 00:48:43,937 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | perturb_xgb_depth_random : False 2021-08-20 00:48:43,942 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_autodl : True 2021-08-20 00:48:43,945 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_load_data_file : False 2021-08-20 00:48:43,949 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_period : 60 2021-08-20 00:48:43,953 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_sleep_period : 0.1 2021-08-20 00:48:43,956 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_options : [] 2021-08-20 00:48:43,959 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_overall_retries : 2 2021-08-20 00:48:43,962 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_retries : 5 2021-08-20 00:48:43,965 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_timeout : 15 2021-08-20 00:48:43,971 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_use_constraint : True 2021-08-20 00:48:43,974 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_verbosity : 2 2021-08-20 00:48:43,977 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | poisson_max_delta_step_list : [0.7, 0.9, 0.5, 0.2] 2021-08-20 00:48:43,982 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pred_labels : True 2021-08-20 00:48:43,986 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | predict_shuffle_inside_model : True 2021-08-20 00:48:43,989 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prediction_intervals : True 2021-08-20 00:48:43,993 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prediction_intervals_alpha : 0.9 2021-08-20 00:48:43,998 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_oom_reduced_features : True 2021-08-20 00:48:44,002 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_reduced_features_for_final_model : True 2021-08-20 00:48:44,006 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_varimp_reduced_features : False 2021-08-20 00:48:44,009 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_varimp_reduced_features_for_rescored : True 2021-08-20 00:48:44,013 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | print_recipe_code_once_accepted : True 2021-08-20 00:48:44,017 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_add_genes : 0.5 2021-08-20 00:48:44,023 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_addbest_genes : 0.5 2021-08-20 00:48:44,027 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_perturb_xgb : 0.25 2021-08-20 00:48:44,030 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_prune_by_features : 0.25 2021-08-20 00:48:44,033 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_prune_genes : 0.5 2021-08-20 00:48:44,037 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_tune_model_vs_features : 0.5 2021-08-20 00:48:44,040 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | produce_correlation_heatmap : False 2021-08-20 00:48:44,043 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | python_client_path : 2021-08-20 00:48:44,049 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | python_client_url : https://s3.amazonaws.com/artifacts.h2o.ai/releases/ai/h2o/driverlessai/latest_release_whl.html 2021-08-20 00:48:44,052 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | python_client_verify_integrity : True 2021-08-20 00:48:44,057 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_bert_model_correct_bias : False 2021-08-20 00:48:44,069 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_bert_model_initial_lr : 2e-05 2021-08-20 00:48:44,072 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_fine_tuning_batch_size : -1 2021-08-20 00:48:44,075 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_fine_tuning_num_epochs : -1 2021-08-20 00:48:44,078 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_fine_tuning_padding_length : -1 2021-08-20 00:48:44,081 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_pretrained_models : ['bert-base-uncased', 'distilbert-base-uncased'] 2021-08-20 00:48:44,084 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_pretrained_models_dir : 2021-08-20 00:48:44,088 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_precision : 16 2021-08-20 00:48:44,091 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_tokenizer_parallel : True 2021-08-20 00:48:44,095 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | quantile_alpha : [0.9, 0.95, 0.99, 0.6] 2021-08-20 00:48:44,097 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rdelta_percent_score_penalty_per_feature_by_interpretability : {1: 0.0, 2: 0.1, 3: 1.0, 4: 2.0, 5: 5.0, 6: 10.0, 7: 20.0, 8: 30.0, 9: 50.0, 10: 100.0, 11: 100.0, 12: 100.0, 13: 100.0} 2021-08-20 00:48:44,101 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe : auto 2021-08-20 00:48:44,104 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_dict * : {} 2021-08-20 00:48:44,107 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_load_raise_on_any_error : True 2021-08-20 00:48:44,111 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_load_raise_on_first_error : False 2021-08-20 00:48:44,114 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_load_raise_on_first_error_but_keep_accepted_recipes : False 2021-08-20 00:48:44,118 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_supported_file_types * : ['py', 'pyc', 'zip'] 2021-08-20 00:48:44,121 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_test_import_after_load_package : False 2021-08-20 00:48:44,125 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipes_temporary_data_directory : recipe_tmp 2021-08-20 00:48:44,128 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_db * : 0 2021-08-20 00:48:44,132 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_ip * : 127.0.0.1 2021-08-20 00:48:44,135 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_port * : 6379 2021-08-20 00:48:44,138 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_result_queue_polling_interval : 100 2021-08-20 00:48:44,143 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_by_fraction : 0.1 2021-08-20 00:48:44,147 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_count_max : 10 2021-08-20 00:48:44,149 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_mojo_size : False 2021-08-20 00:48:44,152 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_repeats_when_failure : 1 2021-08-20 00:48:44,155 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | refit_same_best_individual : False 2021-08-20 00:48:44,157 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reg_lambda_glm_default : 0.0004 2021-08-20 00:48:44,160 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_dup_genes : True 2021-08-20 00:48:44,164 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_scored_0gain_genes_in_postprocessing_above_interpretability : 13 2021-08-20 00:48:44,167 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_scored_0gain_genes_in_postprocessing_above_interpretability_final_population : 2 2021-08-20 00:48:44,172 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_scored_by_threshold_genes_in_postprocessing_above_interpretability_final_population : 7 2021-08-20 00:48:44,176 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reproducibility_level : 1 2021-08-20 00:48:44,181 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | require_graphviz : True 2021-08-20 00:48:44,184 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | restart_refit_redo_origfs_shift_leak : [] 2021-08-20 00:48:44,187 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | roc_reduce_type : rows 2021-08-20 00:48:44,193 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | round_up_indivs_for_busy_gpus : True 2021-08-20 00:48:44,196 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rows_ref : 2000000 2021-08-20 00:48:44,202 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_accuracy_switch : 8 2021-08-20 00:48:44,206 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_interpretability_switch : 1 2021-08-20 00:48:44,209 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_max_num_rules : -1 2021-08-20 00:48:44,213 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_max_num_trees : 100 2021-08-20 00:48:44,220 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_max_tree_depth : 6 2021-08-20 00:48:44,223 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | s3_connector_cert_location : 2021-08-20 00:48:44,227 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | s3_init_path : s3:// 2021-08-20 00:48:44,230 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | s3_skip_cert_verification : False 2021-08-20 00:48:44,233 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | sample_cols_to_group_by : False 2021-08-20 00:48:44,237 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | sanitize_natural_sort_limit : 1000 2021-08-20 00:48:44,240 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | save_validation_splits : False 2021-08-20 00:48:44,244 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | scale_mem_for_max_bin : 10737418240 2021-08-20 00:48:44,247 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | scorers_need_x : False 2021-08-20 00:48:44,251 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | seed : 1234 2021-08-20 00:48:44,257 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | server_recipe_url : 2021-08-20 00:48:44,260 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | set_method_sampling_row_limit : 5000000 2021-08-20 00:48:44,264 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_check_reduced_features : True 2021-08-20 00:48:44,267 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_check_text : False 2021-08-20 00:48:44,270 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_high_notification_level : 0.8 2021-08-20 00:48:44,273 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_key_features_varimp : 0.01 2021-08-20 00:48:44,276 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_max_bin : 256 2021-08-20 00:48:44,278 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_max_max_depth : 8 2021-08-20 00:48:44,282 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_min_max_depth : 4 2021-08-20 00:48:44,285 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_trees : 100 2021-08-20 00:48:44,299 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_all_filesystems : False 2021-08-20 00:48:44,302 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_constant_model : False 2021-08-20 00:48:44,305 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_fold_stats : True 2021-08-20 00:48:44,315 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_full_pipeline_details : False 2021-08-20 00:48:44,318 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_inapplicable_models_preview : False 2021-08-20 00:48:44,322 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_inapplicable_transformers_preview : False 2021-08-20 00:48:44,325 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_warnings_preview : False 2021-08-20 00:48:44,329 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_warnings_preview_unused_map_features : True 2021-08-20 00:48:44,334 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | size_search_stack : 100 2021-08-20 00:48:44,338 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | size_sub_stack : 100 2021-08-20 00:48:44,342 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | skip_disabled_recipes : False 2021-08-20 00:48:44,346 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | skip_model_failures : True 2021-08-20 00:48:44,350 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | skip_transformer_failures : True 2021-08-20 00:48:44,354 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | snowflake_allow_stages : True 2021-08-20 00:48:44,358 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | snowflake_batch_size : 10000 2021-08-20 00:48:44,361 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_ca_file : 2021-08-20 00:48:44,365 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_client_crt_file : 2021-08-20 00:48:44,368 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_client_key_file : 2021-08-20 00:48:44,375 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_client_verify_mode : CERT_NONE 2021-08-20 00:48:44,377 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_crt_file : /etc/dai/cert.pem 2021-08-20 00:48:44,381 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_key_file : /etc/dai/private_key.pem 2021-08-20 00:48:44,385 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_sslv2 : True 2021-08-20 00:48:44,388 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_sslv3 : True 2021-08-20 00:48:44,391 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1 : True 2021-08-20 00:48:44,399 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1_1 : True 2021-08-20 00:48:44,402 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1_2 : False 2021-08-20 00:48:44,405 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1_3 : False 2021-08-20 00:48:44,409 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stabilize_features : True 2021-08-20 00:48:44,414 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stabilize_fs : True 2021-08-20 00:48:44,418 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stabilize_varimp : True 2021-08-20 00:48:44,421 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stall_disk_limit_gb : 1 2021-08-20 00:48:44,424 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stall_subprocess_submission_dai_fork_threshold_count : 0 2021-08-20 00:48:44,428 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stall_subprocess_submission_mem_threshold_pct : 2 2021-08-20 00:48:44,434 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_cpu_measure_interval : -1 2021-08-20 00:48:44,438 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_pool_cpu_percent_threshold_kill : 5.0 2021-08-20 00:48:44,442 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_pool_gpu_percent_threshold_kill : 5.0 2021-08-20 00:48:44,449 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_reference_high_threshold : 1000000 2021-08-20 00:48:44,453 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_kill_ref : 440.0 2021-08-20 00:48:44,456 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_min : 120.0 2021-08-20 00:48:44,459 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_nrows_ref : 1000000 2021-08-20 00:48:44,462 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_nrowscols_ref : 10000000 2021-08-20 00:48:44,466 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_ref : 240.0 2021-08-20 00:48:44,469 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | start_dask_worker * : True 2021-08-20 00:48:44,488 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | statistical_threshold_data_size_large : 500000000 2021-08-20 00:48:44,492 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | statistical_threshold_data_size_small : 100000 2021-08-20 00:48:44,495 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stop_early_abs_std : 0.001 2021-08-20 00:48:44,498 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stop_early_rel_std : 0.1 2021-08-20 00:48:44,502 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stratify_for_regression : True 2021-08-20 00:48:44,505 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | strict_gpu_non_overlap : False 2021-08-20 00:48:44,509 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_image_max_missing_fraction : 0.1 2021-08-20 00:48:44,512 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_image_min_valid_types_fraction : 0.8 2021-08-20 00:48:44,515 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_text_min_absolute_cardinality : 10000 2021-08-20 00:48:44,518 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_text_min_relative_cardinality : 0.1 2021-08-20 00:48:44,522 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_text_threshold : 0.3 2021-08-20 00:48:44,525 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | supported_file_types * : ['csv', 'tsv', 'txt', 'dat', 'tgz', 'gz', 'bz2', 'zip', 'xz', 'xls', 'xlsx', 'jay', 'feather', 'bin', 'arff', 'parquet', 'pkl', 'orc', 'avro'] 2021-08-20 00:48:44,528 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | supported_image_types : ['jpg', 'jpeg', 'png', 'bmp', 'ppm', 'tif', 'tiff', 'JPG', 'JPEG', 'PNG', 'BMP', 'PPM', 'TIF', 'TIFF'] 2021-08-20 00:48:44,532 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | switch_from_tree_to_lgbm_if_can : True 2021-08-20 00:48:44,535 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | target_transformer : auto 2021-08-20 00:48:44,538 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | te_bin_list : [25, 10, 100, 250] 2021-08-20 00:48:44,541 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_accuracy_switch : 5 2021-08-20 00:48:44,544 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_allow_cpu_only : False 2021-08-20 00:48:44,547 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_check_import : True 2021-08-20 00:48:44,551 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_cores : 0 2021-08-20 00:48:44,554 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_disable_memory_optimization : True 2021-08-20 00:48:44,557 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_augmentations : ['HorizontalFlip'] 2021-08-20 00:48:44,563 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_batch_size : -1 2021-08-20 00:48:44,566 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_fine_tune : False 2021-08-20 00:48:44,570 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_fine_tuning_num_epochs : 2 2021-08-20 00:48:44,573 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_pretrained_models : ['xception'] 2021-08-20 00:48:44,576 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_pretrained_models_dir : ./pretrained/image/ 2021-08-20 00:48:44,587 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_use_gpu : True 2021-08-20 00:48:44,591 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_vectorization_output_dimension : [100] 2021-08-20 00:48:44,593 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_interpretability_switch : 6 2021-08-20 00:48:44,596 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_max_epochs_nlp : 2 2021-08-20 00:48:44,601 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_nlp_have_gpus_in_production : False 2021-08-20 00:48:44,604 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_nlp_pretrained_embeddings_file_path : 2021-08-20 00:48:44,607 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_nlp_pretrained_embeddings_trainable : False 2021-08-20 00:48:44,609 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_num_classes_switch : 10 2021-08-20 00:48:44,612 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_num_classes_switch_but_keep_lightgbm : 15 2021-08-20 00:48:44,615 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_use_all_cores : True 2021-08-20 00:48:44,619 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_use_all_cores_even_if_reproducible_true : False 2021-08-20 00:48:44,622 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | terminate_train_backend_tuning : True 2021-08-20 00:48:44,626 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | terminate_train_feature_evolution : True 2021-08-20 00:48:44,629 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | terminate_train_tuning : True 2021-08-20 00:48:44,632 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_as_categorical_cardinality_threshold : 1000 2021-08-20 00:48:44,635 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_dl_token_pad_max : 512 2021-08-20 00:48:44,638 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_dl_token_pad_percentile : 99 2021-08-20 00:48:44,642 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_fraction_for_text_dominated_problem : 0.3 2021-08-20 00:48:44,645 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_gene_dim_reduction_choices : [50] 2021-08-20 00:48:44,649 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_gene_max_ngram : [1, 2] 2021-08-20 00:48:44,652 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_transformer_fraction_for_text_dominated_problem : 0.3 2021-08-20 00:48:44,655 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_transformers_max_vocabulary_size : [1000, 5000] 2021-08-20 00:48:44,659 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | textlin_num_classes_switch : 5 2021-08-20 00:48:44,662 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tf_nan_impute_value : -5 2021-08-20 00:48:44,665 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | threshold_data_size_large_to_use_cpu_for_fs : 100000000 2021-08-20 00:48:44,669 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | threshold_scorer : AUTO 2021-08-20 00:48:44,672 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | time_abort : 2021-08-20 00:48:44,675 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | time_abort_format : %Y-%m-%d %H:%M:%S 2021-08-20 00:48:44,678 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | time_abort_timezone : UTC 2021-08-20 00:48:44,681 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | torch_check_import : True 2021-08-20 00:48:44,684 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_feature_style_accuracy_switch : 13 2021-08-20 00:48:44,686 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_fullstack_style_accuracy_switch : 13 2021-08-20 00:48:44,689 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_model_style_accuracy_switch : 6 2021-08-20 00:48:44,693 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_style : auto 2021-08-20 00:48:44,696 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_uniform_style_accuracy_switch : 6 2021-08-20 00:48:44,699 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_uniform_style_interpretability_switch : 8 2021-08-20 00:48:44,702 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_use_feature_penalized_score : True 2021-08-20 00:48:44,705 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | trace_lines_transformers : False 2021-08-20 00:48:44,712 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | training_report_period : 10 2021-08-20 00:48:44,715 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | transformer_description_line_length : -1 2021-08-20 00:48:44,718 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | transformer_precision : float32 2021-08-20 00:48:44,722 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tune_learning_rate : False 2021-08-20 00:48:44,725 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tune_parameters_accuracy_switch : 3 2021-08-20 00:48:44,728 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tune_target_transform_accuracy_switch : 5 2021-08-20 00:48:44,731 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tuning_share_varimp : best 2021-08-20 00:48:44,734 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tuning_share_varimp_accuracy_switch : 5 2021-08-20 00:48:44,737 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tweedie_variance_power_list : [1.5, 1.2, 1.9] 2021-08-20 00:48:44,740 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ulimit_up_to_hard_limit : True 2021-08-20 00:48:44,750 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | uniquify_indiv : True 2021-08-20 00:48:44,758 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | unsupervised_clustering_max_clusters : 10 2021-08-20 00:48:44,761 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | unsupervised_clustering_min_clusters : 2 2021-08-20 00:48:44,764 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_187_prob_logic : True 2021-08-20 00:48:44,766 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_all_columns_klime_kmeans : False 2021-08-20 00:48:44,769 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dask_cluster : True 2021-08-20 00:48:44,772 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dask_for_1_gpu : False 2021-08-20 00:48:44,775 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool : False 2021-08-20 00:48:44,778 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_capture_schema : False 2021-08-20 00:48:44,781 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_check_indiv : False 2021-08-20 00:48:44,784 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_detect_types : False 2021-08-20 00:48:44,788 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_dl2 : False 2021-08-20 00:48:44,791 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_final_munging : False 2021-08-20 00:48:44,795 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_final_predict : False 2021-08-20 00:48:44,798 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_final_training : False 2021-08-20 00:48:44,802 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_fs : False 2021-08-20 00:48:44,805 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_lgbm_fit : False 2021-08-20 00:48:44,809 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_mojo : False 2021-08-20 00:48:44,812 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_munging : False 2021-08-20 00:48:44,815 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_mutate : False 2021-08-20 00:48:44,819 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_onetask : False 2021-08-20 00:48:44,822 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_predict : False 2021-08-20 00:48:44,825 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_score : False 2021-08-20 00:48:44,828 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_training : False 2021-08-20 00:48:44,831 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_xgb_fit : False 2021-08-20 00:48:44,834 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_feature_brain_new_experiments : False 2021-08-20 00:48:44,838 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_forkdatacontext : True 2021-08-20 00:48:44,845 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_global_isolation_pool : False 2021-08-20 00:48:44,848 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_native_cats_for_lgbm_fs : True 2021-08-20 00:48:44,850 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_rf_for_leakage_if_have_lgbm : True 2021-08-20 00:48:44,852 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_rf_for_shift_if_have_lgbm : True 2021-08-20 00:48:44,854 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_xgboost_xgbfi : False 2021-08-20 00:48:44,857 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | validate_meta_learner : True 2021-08-20 00:48:44,860 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | validate_meta_learner_extra : False 2021-08-20 00:48:44,863 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | varimp_fspermute_factor : 1.0 2021-08-20 00:48:44,869 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | varimp_threshold_at_interpretability_10 : 0.01 2021-08-20 00:48:44,873 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | varimp_threshold_shift_report : 0.3 2021-08-20 00:48:44,876 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | verify_ipc_requests : True 2021-08-20 00:48:44,879 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | verify_session_ip : False 2021-08-20 00:48:44,883 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | version_old_custom : False 2021-08-20 00:48:44,886 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | version_old_custom_by_filename : False 2021-08-20 00:48:44,889 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | vis_server_ip : 127.0.0.1 2021-08-20 00:48:44,892 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | vis_server_port * : 12346 2021-08-20 00:48:44,897 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | warning_unused_feature_show_max : 3 2021-08-20 00:48:44,901 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | which_iteration_brain : -1 2021-08-20 00:48:44,912 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | woe_bin_list : [25, 10, 100, 250] 2021-08-20 00:48:44,915 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_healthy_response_period : 300 2021-08-20 00:48:44,918 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_local_processors : 32 2021-08-20 00:48:44,921 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_mode * : singlenode 2021-08-20 00:48:44,924 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_no_main_server_wait_time : 1800 2021-08-20 00:48:44,927 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_no_main_server_wait_time_with_hard_assert : 30 2021-08-20 00:48:44,931 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_priority_queues_processors : 4 2021-08-20 00:48:44,934 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_priority_queues_time_check : 30 2021-08-20 00:48:44,937 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_remote_processors * : 2 2021-08-20 00:48:44,942 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_remote_processors_max_threads_reduction_factor : 0.7 2021-08-20 00:48:44,946 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_start_timeout : 30 2021-08-20 00:48:44,951 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | working_munging_max_transformers : 100 2021-08-20 00:48:44,956 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | working_munging_report_period : 120 2021-08-20 00:48:44,961 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | working_training_report_period : 60 2021-08-20 00:48:44,965 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | write_recipes_to_experiment_folder : True 2021-08-20 00:48:44,970 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | write_recipes_to_experiment_logger : False 2021-08-20 00:48:44,975 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgb_memory_pickled_estimate : False 2021-08-20 00:48:44,980 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_accuracy_switch : 1 2021-08-20 00:48:44,985 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_binary_metrics : ['logloss', 'auc', 'aucpr', 'error'] 2021-08-20 00:48:44,990 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_direct_datatable : False 2021-08-20 00:48:44,994 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_interpretability_switch : 10 2021-08-20 00:48:44,999 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_reduce_on_errors_list : ['Memory allocation error on worker', 'out of memory', 'XGBDefaultDeviceAllocatorImpl', 'invalid configuration argument', 'Requested memory'] 2021-08-20 00:48:45,003 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_reg_metrics : ['rmse', 'mae'] 2021-08-20 00:48:45,008 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_reg_objectives : ['reg:squarederror'] 2021-08-20 00:48:45,012 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_rf_exact_threshold_num_rows_x_cols : 10000 2021-08-20 00:48:45,016 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:45,021 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,024 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Environment Variables 2021-08-20 00:48:45,028 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:45,032 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_DEFAULT_ENV : base 2021-08-20 00:48:45,035 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_EXE : /opt/h2oai/dai/python/bin/conda 2021-08-20 00:48:45,038 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_PREFIX : /opt/h2oai/dai/python 2021-08-20 00:48:45,041 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_PROMPT_MODIFIER : (base) 2021-08-20 00:48:45,054 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_PYTHON_EXE : /opt/h2oai/dai/python/bin/python 2021-08-20 00:48:45,057 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_SHLVL : 1 2021-08-20 00:48:45,061 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CPL_ZIP_ENCODING : UTF-8 2021-08-20 00:48:45,065 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CUDA_DEVICE_ORDER : PCI_BUS_ID 2021-08-20 00:48:45,069 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CUDA_PATH : /opt/h2oai/dai/python 2021-08-20 00:48:45,073 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CUDA_VERSION : 11.2.2 2021-08-20 00:48:45,076 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_ENV_QUIET : 1 2021-08-20 00:48:45,079 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_INSTANCE_ID : 32a599f3-7f7e-43c8-9590-b51cd5a77e4d 2021-08-20 00:48:45,083 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_WORKER : true 2021-08-20 00:48:45,086 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_WORKER_IP : 192.168.254.2 2021-08-20 00:48:45,090 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_CONFIG_FILE : /etc/dai/config.toml 2021-08-20 00:48:45,093 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_CUDA_VERSION : cuda-11.2 2021-08-20 00:48:45,096 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_DATA_DIRECTORY : ./tmp 2021-08-20 00:48:45,099 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_IP : 127.0.0.1 2021-08-20 00:48:45,103 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_MLI_NTHREADS : 8 2021-08-20 00:48:45,106 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_PORT : 12348 2021-08-20 00:48:45,109 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_XMX : 64457m 2021-08-20 00:48:45,112 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_HOME : /opt/h2oai/dai 2021-08-20 00:48:45,115 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_INSTANCE_ID : a18969fe-fbed-48b2-9d39-ac7bd71fffbd 2021-08-20 00:48:45,118 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_JAVA_HOME : /opt/h2oai/dai/jre 2021-08-20 00:48:45,122 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_MLI_CLOUD_NAME : H2O-MLI-DAI-20500 2021-08-20 00:48:45,125 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_PROCSY_PORT : 12347 2021-08-20 00:48:45,128 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_REDIS_PORT : 6379 2021-08-20 00:48:45,138 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_VIS_SERVER_PORT : 12346 2021-08-20 00:48:45,142 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_VIS_SERVER_XMX : 5g 2021-08-20 00:48:45,145 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | GDAL_DATA : /opt/h2oai/dai/python/share/gdal 2021-08-20 00:48:45,148 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | GSETTINGS_SCHEMA_DIR : /opt/h2oai/dai/python/share/glib-2.0/schemas 2021-08-20 00:48:45,151 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | GSETTINGS_SCHEMA_DIR_CONDA_BACKUP : 2021-08-20 00:48:45,154 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | HOME : /opt/h2oai/dai/home 2021-08-20 00:48:45,157 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | HOSTNAME : a2791a61aa6b 2021-08-20 00:48:45,161 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_HOME : /opt/h2oai/dai/jre 2021-08-20 00:48:45,164 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_HOME_CONDA_BACKUP : 2021-08-20 00:48:45,166 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_LD_LIBRARY_PATH : /opt/h2oai/dai/python/jre/lib/amd64/server 2021-08-20 00:48:45,169 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_LD_LIBRARY_PATH_BACKUP : 2021-08-20 00:48:45,173 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | KMP_DUPLICATE_LIB_OK : True 2021-08-20 00:48:45,176 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | KMP_INIT_AT_FORK : FALSE 2021-08-20 00:48:45,179 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LANG : en_US.utf8 2021-08-20 00:48:45,183 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LC_ALL : en_US.utf8 2021-08-20 00:48:45,186 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LD_LIBRARY_PATH : /opt/h2oai/dai/python/lib:/opt/h2oai/dai/python/lib:/opt/h2oai/dai/python/lib:/opt/h2oai/dai/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/lib64/:/usr/lib64/ 2021-08-20 00:48:45,190 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LIBC_FATAL_STDERR_ : 1 2021-08-20 00:48:45,192 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LIBRARY_PATH : /usr/local/cuda/lib64/stubs 2021-08-20 00:48:45,194 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MAGIC : /opt/h2oai/dai/share/misc/magic 2021-08-20 00:48:45,198 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MINIO_ACCESS_KEY : GMCSE2K2T3RV6YEHJUYW 2021-08-20 00:48:45,201 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MINIO_ADDRESS : 0.0.0.0:9001 2021-08-20 00:48:45,204 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MINIO_DIR : /opt/h2oai/dai/minio-data/ 2021-08-20 00:48:45,212 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MKL_NUM_THREADS : 3 2021-08-20 00:48:45,215 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NCCL_VERSION : 2.8.4 2021-08-20 00:48:45,221 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NUMEXPR_MAX_THREADS : 3 2021-08-20 00:48:45,225 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVARCH : x86_64 2021-08-20 00:48:45,228 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_DRIVER_CAPABILITIES : compute,utility 2021-08-20 00:48:45,232 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_REQUIRE_CUDA : cuda>=11.2 brand=tesla,driver>=418,driver<419 brand=tesla,driver>=440,driver<441 driver>=450 2021-08-20 00:48:45,236 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_TF32_OVERRIDE : 0 2021-08-20 00:48:45,239 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_VISIBLE_DEVICES : all 2021-08-20 00:48:45,242 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDA_CUDART_DEV_VERSION : 11.2.152-1 2021-08-20 00:48:45,246 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDA_CUDART_VERSION : 11.2.152-1 2021-08-20 00:48:45,249 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDA_LIB_VERSION : 11.2.2-1 2021-08-20 00:48:45,256 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDNN_PACKAGE : libcudnn8-devel-8.1.1.33-1.cuda11.2 2021-08-20 00:48:45,258 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDNN_VERSION : 8.1.1.33-1 2021-08-20 00:48:45,261 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBCUBLAS_DEV_VERSION : 11.4.1.1043-1 2021-08-20 00:48:45,264 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBCUBLAS_VERSION : 11.4.1.1043-1 2021-08-20 00:48:45,267 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_DEV_PACKAGE : libnccl-devel-2.8.4-1+cuda11.2 2021-08-20 00:48:45,270 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_DEV_PACKAGE_NAME : libnccl-devel 2021-08-20 00:48:45,273 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_DEV_PACKAGE_VERSION : 2.8.4-1 2021-08-20 00:48:45,276 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_PACKAGE : libnccl-2.8.4-1+cuda11.2 2021-08-20 00:48:45,280 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_PACKAGE_NAME : libnccl 2021-08-20 00:48:45,283 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_PACKAGE_VERSION : 2.8.4-1 2021-08-20 00:48:45,287 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_VERSION : 2.8.4 2021-08-20 00:48:45,290 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNPP_DEV_VERSION : 11.3.2.152-1 2021-08-20 00:48:45,293 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNPP_VERSION : 11.3.2.152-1 2021-08-20 00:48:45,296 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_NVML_DEV_VERSION : 11.2.152-1 2021-08-20 00:48:45,299 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_NVPROF_VERSION : 11.2.152-1 2021-08-20 00:48:45,303 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_NVTX_VERSION : 11.2.152-1 2021-08-20 00:48:45,308 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | OMP_NUM_THREADS : 3 2021-08-20 00:48:45,312 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | OPENBLAS_MAIN_FREE : 1 2021-08-20 00:48:45,317 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | OPENBLAS_NUM_THREADS : 3 2021-08-20 00:48:45,322 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PATH : /opt/h2oai/dai/nodejs/bin:/opt/h2oai/dai/python/bin:/opt/h2oai/dai/bin:/opt/h2oai/dai/jre/bin:/opt/h2oai/dai/cuda-11.2/bin//opt/h2oai/dai/python/bin:/opt/h2oai/dai/python/condabin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2021-08-20 00:48:45,324 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PROJ_LIB : /opt/h2oai/dai/python/share/proj 2021-08-20 00:48:45,327 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PROJ_NETWORK : ON 2021-08-20 00:48:45,330 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PWD : /opt/h2oai/dai 2021-08-20 00:48:45,333 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PYTHONPATH : /tmp/n/contrib/env/lib/python3.8/site-packages:/opt/h2oai/dai/tmp/n/contrib/pretransformers:/opt/h2oai/dai/tmp/n/contrib/transformers:/opt/h2oai/dai/tmp/n/contrib/models:/opt/h2oai/dai/tmp/n/contrib/scorers:/opt/h2oai/dai/tmp/n/contrib/data:/opt/h2oai/dai/tmp/n/contrib/explainer 2021-08-20 00:48:45,336 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PYTHONUSERBASE : /opt/h2oai/dai/cuda-11.2 2021-08-20 00:48:45,344 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | REDIS_PASSWORD_FROM_DAI_CONFIG : dnyhr9EDagD0lp9S9Eezyz8FI0Sy8gChWiWn4m0U 2021-08-20 00:48:45,347 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | RUN_DAI_CREATE_PIDFILE : 1 2021-08-20 00:48:45,349 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | RUN_DAI_LOG_DIR : /log/20210818-230644 2021-08-20 00:48:45,352 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | RUN_DAI_PIDFILE_DIR : /log/20210818-230644 2021-08-20 00:48:45,356 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | SEGFAULT_SIGNALS : all 2021-08-20 00:48:45,359 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | SHLVL : 3 2021-08-20 00:48:45,362 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | SSL_CERT_DIR : /etc/pki/tls/certs 2021-08-20 00:48:45,365 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TEMP : ./tmp/TMPDIR 2021-08-20 00:48:45,375 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TF2_BEHAVIOR : 1 2021-08-20 00:48:45,378 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TF_ENABLE_AUTO_MIXED_PRECISION : 0 2021-08-20 00:48:45,381 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TINI_VERSION : v0.19.0 2021-08-20 00:48:45,384 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TMPDIR : /opt/h2oai/dai/tmp/n 2021-08-20 00:48:45,388 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TMP_DIR : ./tmp/TMPDIR 2021-08-20 00:48:45,391 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | XDG_CACHE_HOME : ./tmp/./matplotlib_cachedir_0 2021-08-20 00:48:45,394 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | _ : /opt/h2oai/dai/python/bin/python 2021-08-20 00:48:45,397 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | _CE_CONDA : 2021-08-20 00:48:45,399 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | _CE_M : 2021-08-20 00:48:45,403 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | __DAI_MAIN__ : true 2021-08-20 00:48:45,406 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_dask_server_ip : 192.168.254.2 2021-08-20 00:48:45,409 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_enable_dask_cluster : 0 2021-08-20 00:48:45,412 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_h2o_recipes_name : None 2021-08-20 00:48:45,415 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_h2o_recipes_port : 50361 2021-08-20 00:48:45,418 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_ip : 127.0.0.1 2021-08-20 00:48:45,421 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_access_key_id : GMCSE2K2T3RV6YEHJUYW 2021-08-20 00:48:45,425 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_address : 127.0.0.1:9001 2021-08-20 00:48:45,428 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_bucket : h2oai 2021-08-20 00:48:45,434 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_secret_access_key : JFxmXvE/W1AaqwgyPxAUFsJZRnDWUaeQciZJUe9H 2021-08-20 00:48:45,437 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_redis_password : dnyhr9EDagD0lp9S9Eezyz8FI0Sy8gChWiWn4m0U 2021-08-20 00:48:45,440 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_mli_cloud_name : H2O-MLI-DAI-20500 2021-08-20 00:48:45,444 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_port : 12345 2021-08-20 00:48:45,447 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_redis_db : 0 2021-08-20 00:48:45,449 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_redis_ip : 127.0.0.1 2021-08-20 00:48:45,452 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_redis_port : 6379 2021-08-20 00:48:45,455 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_start_dask_worker : True 2021-08-20 00:48:45,458 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_worker_mode : singlenode 2021-08-20 00:48:45,461 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_worker_remote_processors : 2 2021-08-20 00:48:45,464 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | no_proxy : localhost,127.0.0.1 2021-08-20 00:48:45,468 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,472 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Current working directory: /opt/h2oai/dai 2021-08-20 00:48:45,475 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,479 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | cat /proc/sys/kernel/sem:[32000, 1024000000, 500, 32000] 2021-08-20 00:48:45,482 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,485 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Physical cores: 20 2021-08-20 00:48:45,495 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Physical (psutil) cores: 20 2021-08-20 00:48:45,498 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Total (mp) cores: 40 2021-08-20 00:48:45,501 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Total (psutil) cores: 40 2021-08-20 00:48:45,505 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Total (os) cores: 40 2021-08-20 00:48:45,902 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Threading system info: [{'filepath': '/opt/h2oai/dai/python/lib/libopenblasp-r0.3.17.so', 'prefix': 'libopenblas', 'user_api': 'blas', 'internal_api': 'openblas', 'version': '0.3.17', 'num_threads': 3, 'threading_layer': 'pthreads'}, {'filepath': '/opt/h2oai/dai/python/lib/libgomp.so.1.0.0', 'prefix': 'libgomp', 'user_api': 'openmp', 'internal_api': 'openmp', 'version': None, 'num_threads': 3}] 2021-08-20 00:48:45,910 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Set for no core dumps 2021-08-20 00:48:45,911 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ulimit -n of 1048576 2021-08-20 00:48:45,914 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ulimit -u of 16384 2021-08-20 00:48:45,917 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,921 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Resource limits: {('RLIM_INFINITY', -1): (-1, -1), ('RLIMIT_AS', 9): (-1, -1), ('RLIMIT_CORE', 4): (0, 0), ('RLIMIT_CPU', 0): (-1, -1), ('RLIMIT_DATA', 2): (-1, -1), ('RLIMIT_FSIZE', 1): (-1, -1), ('RLIMIT_LOCKS', 10): (-1, -1), ('RLIMIT_MEMLOCK', 8): (65536, 65536), ('RLIMIT_MSGQUEUE', 12): (819200, 819200), ('RLIMIT_NICE', 13): (0, 0), ('RLIMIT_NOFILE', 7): (1048576, 1048576), ('RLIMIT_NPROC', 6): (16384, 16384), ('RLIMIT_RSS', 5): (-1, -1), ('RLIMIT_RTPRIO', 14): (0, 0), ('RLIMIT_SIGPENDING', 11): (1031055, 1031055), ('RLIMIT_STACK', 3): (-1, -1)} 2021-08-20 00:48:45,924 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,998 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Architecture: x86_64 2021-08-20 00:48:46,002 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU op-mode(s): 32-bit, 64-bit 2021-08-20 00:48:46,005 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Byte Order: Little Endian 2021-08-20 00:48:46,008 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU(s): 40 2021-08-20 00:48:46,011 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | On-line CPU(s) list: 0-39 2021-08-20 00:48:46,014 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Thread(s) per core: 2 2021-08-20 00:48:46,017 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Core(s) per socket: 10 2021-08-20 00:48:46,020 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Socket(s): 2 2021-08-20 00:48:46,026 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | NUMA node(s): 2 2021-08-20 00:48:46,029 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Vendor ID: GenuineIntel 2021-08-20 00:48:46,032 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU family: 6 2021-08-20 00:48:46,035 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Model: 79 2021-08-20 00:48:46,038 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Model name: Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz 2021-08-20 00:48:46,041 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Stepping: 1 2021-08-20 00:48:46,044 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU MHz: 2366.890 2021-08-20 00:48:46,047 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU max MHz: 3100.0000 2021-08-20 00:48:46,051 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU min MHz: 1200.0000 2021-08-20 00:48:46,061 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | BogoMIPS: 4400.07 2021-08-20 00:48:46,066 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Virtualization: VT-x 2021-08-20 00:48:46,069 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L1d cache: 32K 2021-08-20 00:48:46,071 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L1i cache: 32K 2021-08-20 00:48:46,074 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L2 cache: 256K 2021-08-20 00:48:46,078 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L3 cache: 25600K 2021-08-20 00:48:46,081 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | NUMA node0 CPU(s): 0-9,20-29 2021-08-20 00:48:46,088 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | NUMA node1 CPU(s): 10-19,30-39 2021-08-20 00:48:46,091 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb invpcid_single intel_pt ssbd ibrs ibpb stibp kaiser tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdseed adx smap xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts md_clear flush_l1d 2021-08-20 00:48:46,095 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:46,098 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,218 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Fri Aug 20 00:48:46 2021 2021-08-20 00:48:46,222 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-----------------------------------------------------------------------------+ 2021-08-20 00:48:46,225 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | NVIDIA-SMI 460.73.01 Driver Version: 460.73.01 CUDA Version: 11.2 | 2021-08-20 00:48:46,228 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | |-------------------------------+----------------------+----------------------+ 2021-08-20 00:48:46,234 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | 2021-08-20 00:48:46,237 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | 2021-08-20 00:48:46,240 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | | | MIG M. | 2021-08-20 00:48:46,243 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | |===============================+======================+======================| 2021-08-20 00:48:46,246 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 TITAN X (Pascal) On | 00000000:02:00.0 Off | N/A | 2021-08-20 00:48:46,249 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 43% 65C P2 64W / 250W | 819MiB / 12195MiB | 0% Default | 2021-08-20 00:48:46,252 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | | | N/A | 2021-08-20 00:48:46,255 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-------------------------------+----------------------+----------------------+ 2021-08-20 00:48:46,258 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 TITAN X (Pascal) On | 00000000:81:00.0 Off | N/A | 2021-08-20 00:48:46,261 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 46% 71C P2 189W / 250W | 2544MiB / 12196MiB | 72% Default | 2021-08-20 00:48:46,264 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | | | N/A | 2021-08-20 00:48:46,267 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-------------------------------+----------------------+----------------------+ 2021-08-20 00:48:46,271 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:46,274 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-----------------------------------------------------------------------------+ 2021-08-20 00:48:46,277 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | Processes: | 2021-08-20 00:48:46,280 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | GPU GI CI PID Type Process name GPU Memory | 2021-08-20 00:48:46,283 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | ID ID Usage | 2021-08-20 00:48:46,286 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | |=============================================================================| 2021-08-20 00:48:46,288 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 2115 G /usr/lib/xorg/Xorg 137MiB | 2021-08-20 00:48:46,292 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 12601 C ...cp://192.168.254.3:45687] 135MiB | 2021-08-20 00:48:46,295 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36404 C ...ginfit_model_lightgbmdask 135MiB | 2021-08-20 00:48:46,298 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36455 C ...ginfit_model_lightgbmdask 135MiB | 2021-08-20 00:48:46,301 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36708 C ...r [tcp://127.0.0.1:38515] 135MiB | 2021-08-20 00:48:46,304 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36742 C ...r [tcp://127.0.0.1:43950] 135MiB | 2021-08-20 00:48:46,308 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 12603 C ...cp://192.168.254.3:38537] 135MiB | 2021-08-20 00:48:46,311 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 30662 C ...infit_model_TextBERTModel 2135MiB | 2021-08-20 00:48:46,314 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 36701 C ...r [tcp://127.0.0.1:37457] 135MiB | 2021-08-20 00:48:46,317 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 36745 C ...r [tcp://127.0.0.1:42252] 135MiB | 2021-08-20 00:48:46,320 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-----------------------------------------------------------------------------+ 2021-08-20 00:48:46,323 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:46,326 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,329 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,661 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CUDA runtime version detected: 11020 . Need: >= 11020 2021-08-20 00:48:46,667 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CUDA driver version detected: 11020 . Need: >= 11020 2021-08-20 00:48:46,672 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CuDNN version detected: 8100 . Need: >= 8100 2021-08-20 00:48:46,860 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,863 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | System check: 2021-08-20 00:48:47,114 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - GPU(s): PASSED 2021-08-20 00:48:47,951 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - OpenCL: PASSED 2021-08-20 00:48:47,955 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - OpenBLAS: PASSED 2021-08-20 00:48:47,962 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Memory: PASSED 2021-08-20 00:48:47,965 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Disk: PASSED 2021-08-20 00:48:48,024 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Graphviz: PASSED 2021-08-20 00:48:48,027 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Conda: PASSED 2021-08-20 00:48:48,029 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:48,805 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Number of threads for parent process of experiment: OpenBLAS: 1 DataTable: 3 Total: 7 2021-08-20 00:48:48,811 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Ingesting training data... 2021-08-20 00:48:48,815 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 DATA | Reading None data from: ./tmp/n/61efab2a-ef06-11eb-aeb8-0242c0a8fe03/Friedman1-results.csv.1627409626.1267896.bin 2021-08-20 00:48:48,835 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Successfully imported datatable binary file. 2021-08-20 00:48:48,840 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Data shape: (1000, 11) 2021-08-20 00:48:48,843 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Data size: 0.09 MiB 2021-08-20 00:48:48,846 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Time to read the None dataset with datatable: 0.02821016 2021-08-20 00:48:49,264 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 DATA | Training data file name: Friedman1-results.csv 2021-08-20 00:48:49,266 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | H2O Driverless AI Version: 1.10.0 2021-08-20 00:48:49,269 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Selected Accuracy: 7 / 10 2021-08-20 00:48:49,271 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Selected Time: 2 / 10 2021-08-20 00:48:49,274 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Selected Interpretability: 8 / 10 2021-08-20 00:48:49,878 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Turning accuracy/time/interpretability into: 2021-08-20 00:48:49,885 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | individuals: 8 2021-08-20 00:48:49,886 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | iterations=10 2021-08-20 00:48:49,888 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | experiment early_stopping_rounds=5 2021-08-20 00:48:49,891 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | only_first_fold_model=False 2021-08-20 00:48:49,894 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | num_folds=3 2021-08-20 00:48:49,897 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | fold_reps=2 2021-08-20 00:48:49,900 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | monotonicity_constraints=True 2021-08-20 00:48:49,903 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | parameter_tuning_num_models=4 2021-08-20 00:48:49,907 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | auto_tune_target_transform=True 2021-08-20 00:48:49,910 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | auto_tune_backend=True 2021-08-20 00:48:49,913 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | ensemble_level=1 2021-08-20 00:48:49,916 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | num_ensemble_folds=3 2021-08-20 00:48:49,919 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | max_rows=1000 2021-08-20 00:48:49,922 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | max_rows_feature_evolution=1000 2021-08-20 00:48:49,925 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | strategy=FS 2021-08-20 00:48:49,928 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Genetic Algorithm Used=True 2021-08-20 00:48:49,933 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | cols_to_drop=[] 2021-08-20 00:48:50,174 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | show_local_args : function name "" 2021-08-20 00:48:50,176 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | : self = 2021-08-20 00:48:50,178 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Writing autoreport arguments to file: '/opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/args_do_auto_dl.json' 2021-08-20 00:48:50,184 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Time limit for feature evolution: 1440 minute(s) 2021-08-20 00:48:50,187 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Experiment will automatically advance to the final pipeline creation (by hitting the Finish button) after 1 day if not completed. 2021-08-20 00:48:50,190 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Experiment will automatically be aborted after 7 days if not completed. 2021-08-20 00:48:50,232 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | h2oaicore hashes: wheel=4d0fa399cc29d558c62ec11a55d326d1036c08e7 git= jen=None 2021-08-20 00:48:50,235 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using 20 threads. 2021-08-20 00:48:50,238 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using seed: 1037348886 that is random 2021-08-20 00:48:50,244 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Size of file system containing temp dir: 3.8TB 2021-08-20 00:48:50,247 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Available space on file system containing temp dir: 996.4GB 2021-08-20 00:48:50,250 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Temporary directory: ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02 2021-08-20 00:48:50,252 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using datatable version '1.1.0a2071', git revision 'a5cd41'. 2021-08-20 00:48:50,255 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using datatable 'auto' strategy. 2021-08-20 00:48:50,355 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Validation data file name: [Valid] 2021-08-20 00:48:50,358 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Checking data integrity... 2021-08-20 00:48:50,365 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Preparing data... 2021-08-20 00:48:50,735 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.0 -> X_0 2021-08-20 00:48:50,736 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.1 -> X_1 2021-08-20 00:48:50,738 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.2 -> X_2 2021-08-20 00:48:50,740 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.3 -> X_3 2021-08-20 00:48:50,743 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.4 -> X_4 2021-08-20 00:48:50,745 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.5 -> X_5 2021-08-20 00:48:50,747 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.6 -> X_6 2021-08-20 00:48:50,749 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.7 -> X_7 2021-08-20 00:48:50,751 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.8 -> X_8 2021-08-20 00:48:50,752 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.9 -> X_9 2021-08-20 00:48:50,754 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Making column types consistent 1/5. 2021-08-20 00:48:51,043 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking for columns with constant values. 2021-08-20 00:48:51,434 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | No columns with constant values found. 2021-08-20 00:48:51,437 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Training data (with target): (1000, 11) 2021-08-20 00:48:51,462 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | First 10 rows of training data (important columns first): 2021-08-20 00:48:51,464 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | y X_0 X_1 X_2 X_3 X_4 X_5 \ 2021-08-20 00:48:51,465 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 0 10.514909 0.538199 0.213243 0.545909 0.641347 0.101782 0.754774 2021-08-20 00:48:51,467 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 1 22.091112 0.511203 0.672601 0.090410 0.710904 0.640796 0.691265 2021-08-20 00:48:51,469 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2 23.637319 0.656581 0.584439 0.733004 0.905532 0.771787 0.303401 2021-08-20 00:48:51,470 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 3 14.704191 0.597656 0.470689 0.166544 0.398554 0.092230 0.408584 2021-08-20 00:48:51,472 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 4 10.539045 0.293327 0.914270 0.630422 0.285815 0.115279 0.336773 2021-08-20 00:48:51,474 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 5 22.610139 0.801309 0.564802 0.736706 0.706592 0.814840 0.873785 2021-08-20 00:48:51,475 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 6 7.257792 0.577830 0.021487 0.748883 0.089403 0.801798 0.840097 2021-08-20 00:48:51,477 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 7 17.263727 0.519056 0.505974 0.856837 0.218172 0.995577 0.259858 2021-08-20 00:48:51,479 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 8 12.772815 0.871417 0.314405 0.793712 0.273555 0.093837 0.688646 2021-08-20 00:48:51,480 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 9 11.847787 0.264395 0.159089 0.543836 0.519854 0.820067 0.573237 2021-08-20 00:48:51,482 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2021-08-20 00:48:51,484 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | X_6 X_7 X_8 X_9 2021-08-20 00:48:51,485 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 0 0.043807 0.583226 0.856884 0.378225 2021-08-20 00:48:51,487 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 1 0.815222 0.977165 0.838957 0.467587 2021-08-20 00:48:51,489 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2 0.981413 0.662462 0.048219 0.780521 2021-08-20 00:48:51,490 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 3 0.513700 0.351345 0.752186 0.751916 2021-08-20 00:48:51,492 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 4 0.938448 0.601610 0.186782 0.398579 2021-08-20 00:48:51,494 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 5 0.406951 0.618284 0.534756 0.798458 2021-08-20 00:48:51,495 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 6 0.367980 0.285126 0.427309 0.490019 2021-08-20 00:48:51,497 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 7 0.381162 0.792870 0.299612 0.496243 2021-08-20 00:48:51,499 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 8 0.698431 0.948396 0.739914 0.100188 2021-08-20 00:48:51,501 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 9 0.467852 0.177314 0.332409 0.532827 2021-08-20 00:48:51,502 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Using fold_reps=2 2021-08-20 00:48:51,504 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Stats for target column 'y': 2021-08-20 00:48:51,506 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | non-missing count: 1000 2021-08-20 00:48:51,507 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | mean: 14.3507 2021-08-20 00:48:51,509 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | std: 5.00501 2021-08-20 00:48:51,511 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | min: -1.26473 2021-08-20 00:48:51,513 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | max: 27.7104 2021-08-20 00:48:51,514 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | most frequent count: 1 2021-08-20 00:48:51,516 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | uniques: 1000 2021-08-20 00:48:51,518 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | -1.2647256273613907...1.6327903692454502: 5 rows 2021-08-20 00:48:51,519 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 1.6327903692454502...4.530306365852291: 16 rows 2021-08-20 00:48:51,521 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 4.530306365852291...7.427822362459131: 66 rows 2021-08-20 00:48:51,523 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 7.427822362459131...10.325338359065974: 135 rows 2021-08-20 00:48:51,524 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 10.325338359065974...13.222854355672816: 196 rows 2021-08-20 00:48:51,526 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 13.222854355672816...16.120370352279654: 207 rows 2021-08-20 00:48:51,528 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 16.120370352279654...19.017886348886496: 190 rows 2021-08-20 00:48:51,529 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 19.017886348886496...21.915402345493337: 116 rows 2021-08-20 00:48:51,531 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 21.915402345493337...24.81291834210018: 59 rows 2021-08-20 00:48:51,533 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 24.81291834210018...27.71043433870702: 10 rows 2021-08-20 00:48:51,534 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2021-08-20 00:48:51,536 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking target column... 2021-08-20 00:48:51,538 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking response again ... 2021-08-20 00:48:51,540 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking for redundant columns. 2021-08-20 00:48:51,542 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | No redundant columns found. 2021-08-20 00:48:51,543 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | GPU(s): enabled (up to 1 GPUs/model, starting gpu_id=0, 2 chosen GPUs for experiment out of 2 visible GPUs and 2 allowed visible GPUs). 2021-08-20 00:48:51,545 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Early stopping enabled. 2021-08-20 00:48:51,547 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking scorer... 2021-08-20 00:48:51,554 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Scorers 2021-08-20 00:48:51,562 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Scorer: RMSE (less is better) 2021-08-20 00:48:51,911 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Processing custom features... 2021-08-20 00:48:51,913 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Detecting schema... 2021-08-20 00:48:54,081 C: 61% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Detecting column types... 2021-08-20 00:48:55,538 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Time-series check disabled. 2021-08-20 00:48:55,547 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Original column types (will be processed more to get Final column types) 2021-08-20 00:48:55,549 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Date cols: [] 2021-08-20 00:48:55,550 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | DateTime cols: [] 2021-08-20 00:48:55,552 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | ID cols: [] 2021-08-20 00:48:55,554 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Categorical cols: [] 2021-08-20 00:48:55,556 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | OHE Categorical cols: [] 2021-08-20 00:48:55,558 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Numerical cols: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,560 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Text cols: [] 2021-08-20 00:48:55,562 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Image cols: [] 2021-08-20 00:48:55,565 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Time column: None 2021-08-20 00:48:55,567 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Fold column: None 2021-08-20 00:48:55,570 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Weight column: None 2021-08-20 00:48:55,573 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Target column: 'y' 2021-08-20 00:48:55,576 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Numerical as Categorical allowed 2021-08-20 00:48:55,579 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Final column types 2021-08-20 00:48:55,582 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type numeric: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,586 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type categorical: [] 2021-08-20 00:48:55,589 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type catlabel: [] 2021-08-20 00:48:55,591 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type ohe_categorical: [] 2021-08-20 00:48:55,595 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type datetime: [] 2021-08-20 00:48:55,598 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type date: [] 2021-08-20 00:48:55,600 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type text: [] 2021-08-20 00:48:55,603 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type raw: [] 2021-08-20 00:48:55,606 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type time_column: [] 2021-08-20 00:48:55,609 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type all: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,620 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type any: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,626 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type id: [] 2021-08-20 00:48:55,630 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type image: [] 2021-08-20 00:48:56,374 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Models 2021-08-20 00:48:56,376 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for model restriction: Not included ==> dropping ['CONSTANT', 'DECISIONTREE', 'FTRL', 'GLM', 'IMAGEAUTO', 'LIGHTGBMDASK', 'RFCUML', 'RFCUMLDASK', 'RULEFIT', 'TENSORFLOW', 'TEXTALBERT', 'TEXTBERT', 'TEXTCAMEMBERT', 'TEXTDISTILBERT', 'TEXTMULTILINGUALBERT', 'TEXTROBERTA', 'TEXTXLM', 'TEXTXLMROBERTA', 'TEXTXLNET', 'XGBOOSTDART', 'XGBOOSTDARTDASK', 'XGBOOSTGBM', 'XGBOOSTGBMDASK', 'XGBOOSTRF', 'XGBOOSTRFDASK', 'ZEROINFLATEDLIGHTGBM', 'ZEROINFLATEDXGBOOST'] 2021-08-20 00:48:56,532 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Scorers 2021-08-20 00:48:56,543 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:56,549 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Number of individuals: 8 2021-08-20 00:48:56,551 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated target transform tuning iterations: 2 2021-08-20 00:48:56,553 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated model and feature parameter tuning iterations: 4 2021-08-20 00:48:56,556 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated total (tuning + feature evolution) number of iterations: 16 2021-08-20 00:48:56,559 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated total (backend + tuning + feature evolution + final) number of models to train: 597 2021-08-20 00:48:56,561 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Backend tuning: 0 model(s) 2021-08-20 00:48:56,563 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Target transform tuning: 18 model(s) 2021-08-20 00:48:56,566 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Model and feature tuning: 48 model(s) 2021-08-20 00:48:56,568 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Feature pre-pruning: 0 model(s) 2021-08-20 00:48:56,571 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Feature evolution: 528 model(s) 2021-08-20 00:48:56,573 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Final pipeline: 3 model(s) 2021-08-20 00:48:56,576 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:56,616 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Summary of restricting of Transformers 2021-08-20 00:48:56,618 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No image columns ==> dropping ['ImageOriginalGene'] 2021-08-20 00:48:56,620 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No text columns ==> dropping ['TextLinRegressorGene'] 2021-08-20 00:48:56,622 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No time_column columns ==> dropping ['EwmaLagsGene'] 2021-08-20 00:48:56,624 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No date columns ==> dropping ['DateGene'] 2021-08-20 00:48:56,628 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No datetime columns ==> dropping ['DateTimeGene'] 2021-08-20 00:48:56,630 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No raw columns ==> dropping ['RawGene'] 2021-08-20 00:48:56,632 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Lexicographical label encoding or Isolation Forest Anomaly Score encoding disabled ==> dropping ['IsolationForestAnomalyAllColsGene', 'IsolationForestAnomalyAllNumColsGene', 'IsolationForestAnomalyGene', 'IsolationForestAnomalyNumCatGene', 'LexiLabelEncoderGene'] 2021-08-20 00:48:56,633 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Not applicable for regression ==> dropping ['CVTargetEncodeTransformer', 'CatTransformer', 'ClusterTETransformer', 'NumCatTETransformer', 'NumToCatTETransformer', 'NumToCatWoEMonotonicTransformer', 'NumToCatWoETransformer', 'OneHotEncodingTransformer', 'WeightOfEvidenceTransformer'] 2021-08-20 00:48:56,635 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Interpretability (8) out of range ==> dropping ['ClusterDistGene', 'ClusterIDTargetEncodeSingleGene', 'ClusterIdAllNumGene', 'NumToCatTargetEncodeSingleGene', 'StringConcatGene', 'TruncSvdAllNumGene', 'TruncSvdNumGene'] 2021-08-20 00:48:57,083 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 WARNING| - Feature engineering search space: [CVCatNumEncode, CVTargetEncode, Frequent, Interactions, NumCatTE, OneHotEncoding, Original] 2021-08-20 00:48:57,085 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 WARNING| - Feature engineering selected/enabled but inapplicable: [BERT, CVTECUML, CatOriginal, ClusterDistCUMLDask, ClusterDistCUML, ClusterDist, ClusterIdAllNum, ClusterTE, DBSCANCUMLDask, DBSCANCUML, DateOriginal, DateTimeDiff, DateTimeOriginal, Dates, EwmaLags, ImageOriginal, ImageVectorizer, IsHoliday, IsolationForestAnomalyAllNumeric, IsolationForestAnomalyNumCatAllCols, IsolationForestAnomalyNumCat, IsolationForestAnomalyNumeric, LagsAggregates, LagsInteraction, Lags, LexiLabelEncoder, MeanTarget, NumToCatTE, NumToCatWoEMonotonic, NumToCatWoE, Raw, StandardScaler, StringConcat, TSNECUML, TextBiGRU, TextCNN, TextCharCNN, TextLinModel, TextOriginal, Text, TruncSVDAllNum, TruncSVDCUMLDask, TruncSVDCUML, TruncSVDNum, UMAPCUMLDask, UMAPCUML, WeightOfEvidence] 2021-08-20 00:48:57,088 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | LightGBMModel has all input features handled by some transformer 2021-08-20 00:48:57,090 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | LightGBMModel *default* feature->transformer map 2021-08-20 00:48:57,093 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_0 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer', 'InteractionsTransformer'] 2021-08-20 00:48:57,095 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_1 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer', 'InteractionsTransformer'] 2021-08-20 00:48:57,097 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_2 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,100 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_3 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,102 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_4 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,104 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_5 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,107 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_6 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,109 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_7 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,112 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_8 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,115 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_9 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,310 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,313 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Experiment: 59939c96-0150-11ec-a7e1-0242c0a8fe02 2021-08-20 00:48:57,315 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,317 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | ACCURACY [7/10]: 2021-08-20 00:48:57,319 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Training data size: *1,000 rows, 11 cols* 2021-08-20 00:48:57,321 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature evolution: *LightGBM*, *3-fold CV**, 2 reps* 2021-08-20 00:48:57,323 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Final pipeline: *LightGBM, averaged across 3-fold CV splits* 2021-08-20 00:48:57,325 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,327 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | TIME [2/10]: 2021-08-20 00:48:57,329 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature evolution: *8 individuals*, up to *10 iterations* 2021-08-20 00:48:57,331 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Early stopping: After *5* iterations of no improvement 2021-08-20 00:48:57,333 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,334 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | INTERPRETABILITY [8/10]: 2021-08-20 00:48:57,336 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature pre-pruning strategy: Permutation Importance FS 2021-08-20 00:48:57,341 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Monotonicity constraints: enabled 2021-08-20 00:48:57,343 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature engineering search space: [CVCatNumEncode, CVTargetEncode, Frequent, Interactions, NumCatTE, OneHotEncoding, Original] 2021-08-20 00:48:57,345 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,347 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | LightGBM models to train: 2021-08-20 00:48:57,350 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Target transform tuning: *18* 2021-08-20 00:48:57,352 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Model and feature tuning: *48* 2021-08-20 00:48:57,354 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature evolution: *528* 2021-08-20 00:48:57,356 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Final pipeline: *3* 2021-08-20 00:48:57,360 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,362 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated runtime: *minutes* 2021-08-20 00:48:57,363 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Auto-click Finish/Abort if not done in: *1 day*/*7 days* 2021-08-20 00:48:57,367 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,369 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Preparing validation splits... 2021-08-20 00:48:57,378 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [Feature evolution (repeat 1)] Optimized fold splits: Target fold mean (target transformed) stddev: 0.01329 | means: [14.346849, 14.358292, 14.362315, 14.327351, 14.342845, 14.366349] 2021-08-20 00:48:57,398 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 0: KstestResult(statistic=0.02176727625829422, pvalue=0.9998424722802827) 2021-08-20 00:48:57,418 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 1: KstestResult(statistic=0.025154089621855738, pvalue=0.9981216923269776) 2021-08-20 00:48:57,437 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 2: KstestResult(statistic=0.02074638356497427, pvalue=0.9999414082418556) 2021-08-20 00:48:57,469 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [Feature evolution (repeat 2)] Optimized fold splits: Target fold mean (target transformed) stddev: 0.01793 | means: [14.3447695, 14.362441, 14.366518, 14.318932, 14.340719, 14.370607] 2021-08-20 00:48:57,484 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 0: KstestResult(statistic=0.024698351045656434, pvalue=0.9985813106473687) 2021-08-20 00:48:57,500 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 1: KstestResult(statistic=0.027531279405342373, pvalue=0.9937850958604381) 2021-08-20 00:48:57,516 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 2: KstestResult(statistic=0.02358730544637591, pvalue=0.9993204937887651) 2021-08-20 00:48:57,555 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | [Final pipeline ] Optimized fold splits: Target fold mean (target transformed) stddev: 0.01329 | means: [14.346849, 14.358292, 14.362315, 14.327351, 14.342845, 14.366349] 2021-08-20 00:48:57,575 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 0: KstestResult(statistic=0.02176727625829422, pvalue=0.9998424722802827) 2021-08-20 00:48:57,592 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 1: KstestResult(statistic=0.025154089621855738, pvalue=0.9981216923269776) 2021-08-20 00:48:57,607 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 2: KstestResult(statistic=0.02074638356497427, pvalue=0.9999414082418556) 2021-08-20 00:48:57,610 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Not doing time-based splits. 2021-08-20 00:48:57,614 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Feature engineering training / validation splits: 2021-08-20 00:48:57,617 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #1: 666 / 334 - target min -1.264726 / 0.766517, target mean: 14.346850 / 14.358292, target max: 27.710434 / 26.761804, target std: 4.981032 / 5.059986 2021-08-20 00:48:58,203 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #2: 667 / 333 - target min -1.264726 / 2.914631, target mean: 14.362315 / 14.327350, target max: 26.761804 / 27.710434, target std: 4.999868 / 5.022746 2021-08-20 00:48:58,389 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #3: 667 / 333 - target min 0.766517 / -1.264726, target mean: 14.342844 / 14.366349, target max: 27.710434 / 25.879954, target std: 5.037666 / 4.946448 2021-08-20 00:48:58,599 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #4: 666 / 334 - target min -1.264726 / 1.490552, target mean: 14.344769 / 14.362441, target max: 27.710434 / 25.997716, target std: 5.026847 / 4.968671 2021-08-20 00:48:58,803 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #5: 667 / 333 - target min -1.264726 / 1.101135, target mean: 14.366518 / 14.318931, target max: 26.492384 / 27.710434, target std: 4.981698 / 5.058766 2021-08-20 00:48:58,992 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #6: 667 / 333 - target min 1.101135 / -1.264726, target mean: 14.340719 / 14.370606, target max: 27.710434 / 26.492384, target std: 5.010135 / 5.002203 2021-08-20 00:48:59,183 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Doing backend tuning on data of shape (666, 11) / (334, 11) 2021-08-20 00:48:59,186 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Maximum number of rows (train or valid) for feature evolution: 667 2021-08-20 00:48:59,189 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Final ensemble training / validation splits: 2021-08-20 00:48:59,193 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #1: 666 / 334 - target min -1.264726 / 0.766517, target mean: 14.346850 / 14.358292, target max: 27.710434 / 26.761804, target std: 4.981032 / 5.059986 2021-08-20 00:48:59,382 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #2: 667 / 333 - target min -1.264726 / 2.914631, target mean: 14.362315 / 14.327350, target max: 26.761804 / 27.710434, target std: 4.999868 / 5.022746 2021-08-20 00:48:59,574 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #3: 667 / 333 - target min 0.766517 / -1.264726, target mean: 14.342844 / 14.366349, target max: 27.710434 / 25.879954, target std: 5.037666 / 4.946448 2021-08-20 00:48:59,939 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Maximum number of rows (train or valid) for final model/ensemble: 667 2021-08-20 00:48:59,966 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Transformers 2021-08-20 00:48:59,968 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No image columns ==> dropping ['ImageOriginalGene'] 2021-08-20 00:48:59,970 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No text columns ==> dropping ['TextLinRegressorGene'] 2021-08-20 00:48:59,972 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No time_column columns ==> dropping ['EwmaLagsGene'] 2021-08-20 00:48:59,974 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No catlabel columns ==> dropping ['CatMultiGene'] 2021-08-20 00:48:59,976 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No categorical columns ==> dropping ['FrequentGene'] 2021-08-20 00:48:59,977 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No numcat columns ==> dropping ['NumCatTargetEncodeMultiGene'] 2021-08-20 00:48:59,979 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No date columns ==> dropping ['DateGene'] 2021-08-20 00:48:59,981 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No ohe_categorical columns ==> dropping ['OneHotEncodingMultiGene'] 2021-08-20 00:48:59,983 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No datetime columns ==> dropping ['DateTimeGene'] 2021-08-20 00:48:59,985 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No raw columns ==> dropping ['RawGene'] 2021-08-20 00:48:59,987 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Lexicographical label encoding or Isolation Forest Anomaly Score encoding disabled ==> dropping ['IsolationForestAnomalyAllNumColsGene', 'IsolationForestAnomalyGene'] 2021-08-20 00:48:59,989 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Not applicable for regression ==> dropping ['ClusterTETransformer', 'NumToCatTETransformer', 'NumToCatWoEMonotonicTransformer', 'NumToCatWoETransformer'] 2021-08-20 00:48:59,990 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Interpretability (8) out of range ==> dropping ['ClusterDistGene', 'ClusterIDTargetEncodeSingleGene', 'ClusterIdAllNumGene', 'NumToCatTargetEncodeSingleGene', 'TruncSvdAllNumGene', 'TruncSvdNumGene'] 2021-08-20 00:48:59,992 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Transformers used (accuracy=7, time=2, interpretability=8, num_classes=1): ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 00:48:59,994 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Genes used (accuracy=7, time=2, interpretability=8, num_classes=1): ['InteractionsGene', 'OriginalGene'] 2021-08-20 00:49:00,202 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Tournament style: model 2021-08-20 00:49:00,204 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Selecting modeling backend... 2021-08-20 00:49:00,207 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Auto-tuning modeling backend: start. 2021-08-20 00:49:00,479 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Backend candidate Job# 0 Name: LightGBMModel using GPU (if applicable) with Booster: lightgbm 2021-08-20 00:49:00,485 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Backend candidate Job# 1 Name: LightGBMModel using CPU with Booster: lightgbm 2021-08-20 00:49:00,768 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 1 total models across folds, out of population with 1 individuals). 2021-08-20 00:49:01,020 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Completed 2 munging tasks out of 2 total tasks (including identity) for 1 indivs and 1 folds 2021-08-20 00:49:01,032 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348886', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 1) 2021-08-20 00:49:01,035 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 00:49:01,268 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) start. 2021-08-20 00:49:45,416 C: 67% D:995.6GB M:240.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 735.7MB, since last ping: 10.6MB/s. CPU memory usage: 484.2MB, max: 485.3MB CPU: 0% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.4kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 58% Nice: 0% System: 8% Wait: 0% DAIActiveprocs: 3 DAIprocs: 55) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train 1 (1) (True) [1000000, 1000000, 1000000] [0.0, 0.0, 0.0]] 2021-08-20 00:50:49,978 C: 65% D:996.4GB M:239.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 1.3GB, since last ping: 11.4kB/s. CPU memory usage: 486.0MB, max: 487.1MB CPU: 10% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.5kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 61% Nice: 0% System: 8% Wait: 0% DAIActiveprocs: 3 DAIprocs: 53) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train-training_xgb_indiv_0_fold_0] 2021-08-20 00:51:54,921 C: 67% D:995.7GB M:239.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 2.4GB, since last ping: 12.0MB/s. CPU memory usage: 483.7MB, max: 487.4MB CPU: 20% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.5kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 57% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 2 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train-training_xgb_indiv_0_fold_0] 2021-08-20 00:53:00,375 C: 65% D:996.4GB M:237.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 2.5GB, since last ping: 14.4kB/s. CPU memory usage: 487.2MB, max: 487.4MB CPU: 0% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.6kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 58% Nice: 0% System: 7% Wait: 0% DAIActiveprocs: 1 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train-training_xgb_indiv_0_fold_0] 2021-08-20 00:53:51,859 C: 70% D:995.8GB M:242.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1} 2021-08-20 00:53:51,867 C: 70% D:995.8GB M:242.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809'} 2021-08-20 00:53:51,869 C: 70% D:995.8GB M:242.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:53:58,161 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) end. Took 296.89186 seconds. 2021-08-20 00:53:58,174 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) start. 2021-08-20 00:53:58,176 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) start. 2021-08-20 00:53:58,249 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 2 iterations: 2 2021-08-20 00:53:58,253 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) end. Took 0.07701 seconds. 2021-08-20 00:53:58,256 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) end. Took 0.08247 seconds. 2021-08-20 00:53:58,423 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | Completed 1 training tasks out of 1 total tasks for 1 indivs and 1 folds 2021-08-20 00:53:59,296 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 2, model transformed features: 1, total model time: 297.2, fit model time: 297.19 2021-08-20 00:54:00,096 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Auto-tuning found optimal settings: LightGBMModel using GPU (if applicable) 2021-08-20 00:54:00,098 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'pred_gap': None, 'pred_periods': None, 'ufapt': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.8, 'subsample': 0.7, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None} 2021-08-20 00:54:00,101 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Auto-tuning modeling backend: end : Duration: 299.8936 s 2021-08-20 00:54:00,111 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:00,113 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Model(s) explored: ['LightGBMModel']. 2021-08-20 00:54:00,115 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Model(s) not explored due to restrictions: ['ConstantModel', 'DecisionTreeModel', 'FTRLModel', 'GLMModel', 'ImageAutoModel', 'ImbalancedLightGBMModel', 'ImbalancedTensorFlowModel', 'ImbalancedXGBoostGBMModel', 'IsolationForestAnomalyModel', 'LightGBMDaskModel', 'NumClusteringModel', 'NumFreqClusteringModel', 'NumOHEClusteringModel', 'RFCUMLDaskModel', 'RFCUMLModel', 'RuleFitModel', 'TensorFlowModel', 'TextALBERTModel', 'TextBERTModel', 'TextCamemBERTModel', 'TextDistilBERTModel', 'TextMultilingualBERTModel', 'TextRoBERTaModel', 'TextXLMModel', 'TextXLMRobertaModel', 'TextXLNETModel', 'TruncSVDModel', 'UnsupervisedModel', 'XGBoostDartDaskModel', 'XGBoostDartModel', 'XGBoostGBMDaskModel', 'XGBoostGBMModel', 'XGBoostModel', 'XGBoostRFDaskModel', 'XGBoostRFModel', 'ZeroInflatedLightGBMModel', 'ZeroInflatedXGBoostModel']. 2021-08-20 00:54:00,329 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:00,338 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Number of individuals: 8 2021-08-20 00:54:00,340 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated target transform tuning iterations: 2 2021-08-20 00:54:00,342 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated model and feature parameter tuning iterations: 4 2021-08-20 00:54:00,344 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated total (tuning + feature evolution) number of iterations: 16 2021-08-20 00:54:00,346 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated total (backend + tuning + feature evolution + final) number of models to train: 598 2021-08-20 00:54:00,348 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Backend tuning: 1 model(s) 2021-08-20 00:54:00,350 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Target transform tuning: 18 model(s) 2021-08-20 00:54:00,352 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Model and feature tuning: 48 model(s) 2021-08-20 00:54:00,354 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Feature pre-pruning: 0 model(s) 2021-08-20 00:54:00,368 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Feature evolution: 528 model(s) 2021-08-20 00:54:00,371 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Final pipeline: 3 model(s) 2021-08-20 00:54:00,374 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:00,381 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Checking for leakage... 2021-08-20 00:54:00,384 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Checking for leakage in training ... 2021-08-20 00:54:00,433 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 DATA | leakage model params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'rf', 'enable_early_stopping_rounds': True, 'grow_policy': 'depthwise', 'max_depth': 8, 'max_leaves': 256, 'max_bin': 256, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.33, 'subsample': 0.632, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': False, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': None, 'n_estimators': 100, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None} 2021-08-20 00:54:00,569 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (750, 10) start. 2021-08-20 00:54:04,478 C: 28% D:996.4GB M:240.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.0GB, since last ping: 21.2kB/s. CPU memory usage: 482.9MB, max: 752.3MB CPU: 0% Procs: 4 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 251.7kB/s Size: 797.0kB) (Connections: 46 Fds: 196 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 9% Wait: 1% DAIActiveprocs: 3 DAIprocs: 54) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Checking_for_leakage...] 2021-08-20 00:54:30,422 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (750, 10) end. Took 29.85287 seconds. 2021-08-20 00:54:30,596 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (250, 10) start. 2021-08-20 00:54:30,599 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (250, 10) model predict (250, 10) start. 2021-08-20 00:54:30,728 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 00:54:30,732 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (250, 10) model predict (250, 10) end. Took 0.13402 seconds. 2021-08-20 00:54:30,735 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (250, 10) end. Took 0.14125 seconds. 2021-08-20 00:54:31,124 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Time for leakage check for training and None: 30.6861 [secs] 2021-08-20 00:54:31,128 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | No significant leakage detected in training data ( R2: 0.7957284 ) 2021-08-20 00:54:31,537 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 00:54:31,543 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 00:54:31,545 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| Number of tree iterations for tuning and feature evolution models (300) is smaller than iterations for final models (500). 2021-08-20 00:54:31,547 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| If unexpected, change max_nestimators_feature_evolution_factor=0.2 to 1.0 in expert settings. 2021-08-20 00:54:31,550 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| Scores shown during tuning and feature evolution may underestimate performance of final pipeline. 2021-08-20 00:54:31,551 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| Please wait for final scores. 2021-08-20 00:54:31,553 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| 2021-08-20 00:54:31,555 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Regression target transformer tuning... 2021-08-20 00:54:31,886 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | target transform tuning iterations: 2 2021-08-20 00:54:31,889 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Tuned 0/18 target transform tuning models. Tuning [LIGHTGBM] 2021-08-20 00:54:31,893 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:31,895 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 00:54:31,898 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Starting Iteration: 0 2021-08-20 00:54:31,903 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 00:54:32,630 C: 71% D:996.4GB M:240.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 00:54:34,590 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 00:54:34,603 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 00:54:34,607 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 00:54:34,610 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348886', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 00:54:34,613 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 00:54:34,836 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:54:34,957 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:55:09,587 C: 57% D:995.7GB M:239.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.2GB, since last ping: 20.2kB/s. CPU memory usage: 546.5MB, max: 771.0MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 1.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 38% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 1 DAIprocs: 55) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_0_fold_2] 2021-08-20 00:56:15,348 C: 26% D:996.4GB M:241.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.5GB, since last ping: 20.2kB/s. CPU memory usage: 547.4MB, max: 771.0MB CPU: 30% Procs: 5 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 4.5kB/s Size: 1.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 3 DAIprocs: 55) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_0_fold_2] 2021-08-20 00:56:22,956 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:56:22,964 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 00:56:22,965 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:56:23,818 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 108.86090 seconds. 2021-08-20 00:56:23,832 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:56:23,834 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:56:23,904 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 00:56:23,910 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07525 seconds. 2021-08-20 00:56:23,914 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08041 seconds. 2021-08-20 00:56:24,193 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 2 3 and Completed 1 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 00:56:24,203 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 00:56:24,206 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Time: 109.498 s: LIGHTGBM Parameters: OrderedDict([('num_classes', 1), ('num_class', 1), ('booster', 'lightgbm'), ('seed', 1037348886), ('disable_gpus', False), ('n_gpus', 1), ('score_f_name', 'RMSE'), ('labels', None), ('label_counts', None), ('_build_info', {'commit': '4d0fa39', 'version': '1.10.0'}), ('model_class_name', 'LightGBMModel'), ('gpu_id', 0), ('n_jobs', 4), ('random_state', 1037348886), ('time_column', None), ('encoder', None), ('tgc', None), ('pred_gap', None), ('pred_periods', None), ('target', None), ('ufapt', None), ('tsp', None), ('boosting_type', 'gbdt'), ('enable_early_stopping_rounds', True), ('learning_rate', 0.05), ('grow_policy', 'depthwise'), ('max_depth', 10), ('max_leaves', 1024), ('max_bin', 64), ('scale_pos_weight', 1.0), ('max_delta_step', 0.0), ('gamma', 0.0), ('colsample_bytree', 0.8), ('subsample', 0.7), ('subsample_freq', 1), ('reg_lambda', 0.0), ('reg_alpha', 0.0), ('min_child_samples', 1), ('min_data_in_bin', 1), ('min_child_weight', 0.001), ('min_split_gain', 0.0), ('subsample_for_bin', 200000), ('class_weight', None), ('monotonicity_constraints', True), ('objective', 'mse'), ('eval_metric', 'rmse'), ('early_stopping_rounds', 30), ('n_estimators', 300), ('importance_type', 'gain'), ('num_leaves', 1024), ('feature_fraction_seed', 1037348887), ('bagging_seed', 1037348888), ('num_threads', 4), ('device_type', 'gpu'), ('gpu_device_id', 0), ('gpu_platform_id', 0), ('gpu_use_dp', False), ('verbose', -1), ('lossguide', False), ('silent', True), ('accuracy', 7), ('time_tolerance', 2), ('interpretability', 8), ('ensemble_level', 1), ('train_shape', (1000, 11)), ('valid_shape', None), ('model_origin', 'TARGET_TUNING'), ('optuna_trial', None), ('optuna_trial_state', None)]) 2021-08-20 00:56:24,209 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 00:56:24,211 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | Time: 109.498 s: LIGHTGBM 2021-08-20 00:56:24,295 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:56:24,298 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 00:56:24,300 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:56:24,326 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:56:25,477 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 110.64158 seconds. 2021-08-20 00:56:25,489 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:56:25,491 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:56:25,558 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 00:56:25,564 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07250 seconds. 2021-08-20 00:56:25,567 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07783 seconds. 2021-08-20 00:56:25,898 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:56:25,903 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:56:25,905 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 00:56:25,908 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:56:27,637 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 3.30620 seconds. 2021-08-20 00:56:27,650 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:56:27,652 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:56:27,719 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 00:56:27,726 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07275 seconds. 2021-08-20 00:56:27,728 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07852 seconds. 2021-08-20 00:56:28,060 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:57:21,455 C: 24% D:996.4GB M:236.7GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.7GB, since last ping: 6.4kB/s. CPU memory usage: 545.3MB, max: 771.0MB CPU: 69% Procs: 5 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.8kB/s Size: 1.0MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4005 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 10% Wait: 0% DAIActiveprocs: 3 DAIprocs: 54) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_0_fold_5] 2021-08-20 00:58:16,683 C: 25% D:996.4GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:16,689 C: 25% D:996.4GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 00:58:16,691 C: 25% D:996.4GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:22,610 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 116.70691 seconds. 2021-08-20 00:58:22,624 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:58:22,627 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:58:22,702 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 00:58:22,708 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08075 seconds. 2021-08-20 00:58:22,711 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08654 seconds. 2021-08-20 00:58:22,949 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 5 6 and Completed 4 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 00:58:22,953 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 00:58:22,958 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 DATA | Time: 115.017 s: LIGHTGBM Parameters: OrderedDict([('num_classes', 1), ('num_class', 1), ('booster', 'lightgbm'), ('seed', 1037348886), ('disable_gpus', False), ('n_gpus', 1), ('score_f_name', 'RMSE'), ('labels', None), ('label_counts', None), ('_build_info', {'commit': '4d0fa39', 'version': '1.10.0'}), ('model_class_name', 'LightGBMModel'), ('gpu_id', 0), ('n_jobs', 4), ('random_state', 1037348886), ('time_column', None), ('encoder', None), ('tgc', None), ('pred_gap', None), ('pred_periods', None), ('target', None), ('ufapt', None), ('tsp', None), ('boosting_type', 'gbdt'), ('enable_early_stopping_rounds', True), ('learning_rate', 0.05), ('grow_policy', 'depthwise'), ('max_depth', 10), ('max_leaves', 1024), ('max_bin', 64), ('scale_pos_weight', 1.0), ('max_delta_step', 0.0), ('gamma', 0.0), ('colsample_bytree', 0.8), ('subsample', 0.7), ('subsample_freq', 1), ('reg_lambda', 0.0), ('reg_alpha', 0.0), ('min_child_samples', 1), ('min_data_in_bin', 1), ('min_child_weight', 0.001), ('min_split_gain', 0.0), ('subsample_for_bin', 200000), ('class_weight', None), ('monotonicity_constraints', True), ('objective', 'mse'), ('eval_metric', 'rmse'), ('early_stopping_rounds', 30), ('n_estimators', 300), ('importance_type', 'gain'), ('num_leaves', 1024), ('feature_fraction_seed', 1037348887), ('bagging_seed', 1037348888), ('num_threads', 4), ('device_type', 'gpu'), ('gpu_device_id', 0), ('gpu_platform_id', 0), ('gpu_use_dp', False), ('verbose', -1), ('lossguide', False), ('silent', True), ('accuracy', 7), ('time_tolerance', 2), ('interpretability', 8), ('ensemble_level', 1), ('train_shape', (1000, 11)), ('valid_shape', None), ('model_origin', 'TARGET_TUNING'), ('optuna_trial', None), ('optuna_trial_state', None)]) 2021-08-20 00:58:22,962 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 00:58:22,965 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | Time: 115.017 s: LIGHTGBM 2021-08-20 00:58:23,067 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:25,112 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 00:58:25,121 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 00:58:25,122 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:25,925 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.8GB, since last ping: 1.4MB/s. CPU memory usage: 717.2MB, max: 771.0MB CPU: 89% Procs: 5 . GPU memory usage: 149.9MB, max: 149.9MB GPUs usage: 4% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 10.5kB/s Size: 1.0MB) (Connections: 58 Fds: 281 WinHandles: 0 Threads: 13 Maps: 4000 WinOpenFiles: 0) (System-Wide CPU: User: 19% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 3 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_1_fold_0] 2021-08-20 00:58:25,976 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.90898 seconds. 2021-08-20 00:58:25,986 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:25,988 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:26,053 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 00:58:26,060 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07076 seconds. 2021-08-20 00:58:26,062 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07619 seconds. 2021-08-20 00:58:26,327 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:26,333 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 00:58:26,335 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:26,382 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:58:27,784 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 119.72338 seconds. 2021-08-20 00:58:27,795 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:27,798 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:27,868 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 00:58:27,874 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07600 seconds. 2021-08-20 00:58:27,876 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08086 seconds. 2021-08-20 00:58:28,112 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:28,115 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 00:58:28,117 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:28,185 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:29,123 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 2.74028 seconds. 2021-08-20 00:58:29,135 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:58:29,138 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:58:29,213 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 00:58:29,226 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08636 seconds. 2021-08-20 00:58:29,230 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09345 seconds. 2021-08-20 00:58:29,559 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:29,599 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:29,601 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 00:58:29,603 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:30,649 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.46447 seconds. 2021-08-20 00:58:30,659 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:30,661 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:30,722 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 00:58:30,727 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06588 seconds. 2021-08-20 00:58:30,730 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07047 seconds. 2021-08-20 00:58:31,070 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:58:31,109 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:31,112 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 00:58:31,114 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:32,171 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.61031 seconds. 2021-08-20 00:58:32,184 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:32,187 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:32,252 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 00:58:32,258 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07171 seconds. 2021-08-20 00:58:32,261 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07719 seconds. 2021-08-20 00:58:32,507 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:32,509 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 00:58:32,512 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:32,609 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:33,387 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 2.31693 seconds. 2021-08-20 00:58:33,399 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:58:33,401 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:58:33,471 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 00:58:33,478 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07675 seconds. 2021-08-20 00:58:33,481 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08246 seconds. 2021-08-20 00:58:33,768 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 5 12 and Completed 10 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 00:58:33,852 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:33,855 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 00:58:33,858 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:33,908 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:34,718 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.10905 seconds. 2021-08-20 00:58:34,728 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:34,730 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:34,793 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 00:58:34,800 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06906 seconds. 2021-08-20 00:58:34,802 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07395 seconds. 2021-08-20 00:59:30,950 C: 24% D:996.3GB M:233.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 4.4GB, since last ping: 2.3MB/s. CPU memory usage: 508.3MB, max: 771.0MB CPU: 29% Procs: 4 . GPU memory usage: 0B, max: 149.9MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.6kB/s Size: 1.1MB) (Connections: 46 Fds: 209 WinHandles: 0 Threads: 10 Maps: 3189 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 3 DAIprocs: 51) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_1_fold_5] 2021-08-20 01:00:16,360 C: 22% D:996.4GB M:235.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:16,366 C: 22% D:996.4GB M:235.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:16,368 C: 22% D:996.4GB M:235.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:21,485 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 107.57663 seconds. 2021-08-20 01:00:21,496 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:21,498 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:21,563 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:00:21,569 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07060 seconds. 2021-08-20 01:00:21,571 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07534 seconds. 2021-08-20 01:00:21,753 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:00:23,418 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 109.16, fit model time: 109.16 2021-08-20 01:00:23,424 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 110.92, fit model time: 110.92 2021-08-20 01:00:23,426 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 3.5899, fit model time: 3.5891 2021-08-20 01:00:23,427 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 116.99, fit model time: 116.99 2021-08-20 01:00:23,429 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 3.1707, fit model time: 3.1698 2021-08-20 01:00:23,431 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 119.99, fit model time: 119.99 2021-08-20 01:00:23,433 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 3.0246, fit model time: 3.0237 2021-08-20 01:00:23,435 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 2.7106, fit model time: 2.7098 2021-08-20 01:00:23,437 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 2.8901, fit model time: 2.8891 2021-08-20 01:00:23,439 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 2.5857, fit model time: 2.5848 2021-08-20 01:00:23,441 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 2.3871, fit model time: 2.3864 2021-08-20 01:00:23,443 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 107.86, fit model time: 107.86 2021-08-20 01:00:24,515 C: 23% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:00:26,089 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:00:26,341 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:26,422 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:26,617 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:26,619 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:26,621 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:26,688 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:26,691 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:26,693 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:28,239 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.89590 seconds. 2021-08-20 01:00:28,252 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:28,255 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:28,340 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:00:28,348 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.09205 seconds. 2021-08-20 01:00:28,350 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.09840 seconds. 2021-08-20 01:00:28,435 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 2.01287 seconds. 2021-08-20 01:00:28,446 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:28,449 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:28,513 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:00:28,522 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07194 seconds. 2021-08-20 01:00:28,526 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07836 seconds. 2021-08-20 01:00:28,677 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:28,879 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:28,966 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:28,969 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:28,971 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:29,202 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:29,204 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:29,207 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:30,241 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.56225 seconds. 2021-08-20 01:00:30,265 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:30,269 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:30,353 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:00:30,361 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.09301 seconds. 2021-08-20 01:00:30,364 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.10006 seconds. 2021-08-20 01:00:30,448 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.56954 seconds. 2021-08-20 01:00:30,459 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:30,461 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:30,529 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:00:30,535 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07366 seconds. 2021-08-20 01:00:30,538 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07890 seconds. 2021-08-20 01:00:30,714 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:30,944 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:30,968 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:30,970 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:30,972 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:31,214 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:31,217 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:31,219 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:32,121 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.40640 seconds. 2021-08-20 01:00:32,135 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:32,139 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:32,194 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.24978 seconds. 2021-08-20 01:00:32,206 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:32,209 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:32,227 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:00:32,234 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.09491 seconds. 2021-08-20 01:00:32,236 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.10125 seconds. 2021-08-20 01:00:32,280 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 113 iterations: 113 2021-08-20 01:00:32,286 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07683 seconds. 2021-08-20 01:00:32,288 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08206 seconds. 2021-08-20 01:00:32,667 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:32,776 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:32,915 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:32,917 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:32,919 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:33,027 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:33,029 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:33,031 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:34,367 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.58831 seconds. 2021-08-20 01:00:34,380 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:34,382 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:34,462 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:00:34,473 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08854 seconds. 2021-08-20 01:00:34,477 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09544 seconds. 2021-08-20 01:00:34,483 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.81408 seconds. 2021-08-20 01:00:34,498 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:34,500 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:34,571 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:00:34,579 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07771 seconds. 2021-08-20 01:00:34,582 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08403 seconds. 2021-08-20 01:00:34,833 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:34,964 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:35,127 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:35,129 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:35,132 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:35,231 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:35,233 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:35,235 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:35,865 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 4.8GB, since last ping: 22.3kB/s. CPU memory usage: 893.7MB, max: 893.7MB CPU: 439% Procs: 6 . GPU memory usage: 299.9MB, max: 299.9MB GPUs usage: 8% OpenFiles: 0/6291456 (OpenFilesUser: 0) PSThreads: 44 (Disk: Read: 0B/s Write: 172.4kB/s Size: 1.5MB) (Connections: 58 Fds: 298 WinHandles: 0 Threads: 32 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 29% Nice: 0% System: 13% Wait: 0% DAIActiveprocs: 5 DAIprocs: 52) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_1_fold_4] 2021-08-20 01:00:36,281 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.44783 seconds. 2021-08-20 01:00:36,292 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:36,295 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:36,361 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.39744 seconds. 2021-08-20 01:00:36,365 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:00:36,371 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07624 seconds. 2021-08-20 01:00:36,373 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08134 seconds. 2021-08-20 01:00:36,381 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:36,384 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:36,450 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:00:36,457 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07229 seconds. 2021-08-20 01:00:36,459 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08041 seconds. 2021-08-20 01:00:36,616 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:00:36,730 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:36,873 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:37,554 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:37,556 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:37,558 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:37,582 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:37,584 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:37,587 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:38,483 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.60973 seconds. 2021-08-20 01:00:38,494 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:38,496 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:38,569 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 113 iterations: 113 2021-08-20 01:00:38,576 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07862 seconds. 2021-08-20 01:00:38,578 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08480 seconds. 2021-08-20 01:00:38,629 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.89858 seconds. 2021-08-20 01:00:38,642 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:38,645 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:38,717 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:00:38,725 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07963 seconds. 2021-08-20 01:00:38,728 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08583 seconds. 2021-08-20 01:00:38,922 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:00:40,601 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 152, model transformed features: 15, total model time: 2.2211, fit model time: 2.22 2021-08-20 01:00:40,607 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 171, model transformed features: 15, total model time: 2.2865, fit model time: 2.2856 2021-08-20 01:00:40,608 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 1.8863, fit model time: 1.8851 2021-08-20 01:00:40,610 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 15, total model time: 1.8523, fit model time: 1.851 2021-08-20 01:00:40,612 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 119, model transformed features: 15, total model time: 1.7351, fit model time: 1.7169 2021-08-20 01:00:40,614 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 113, model transformed features: 15, total model time: 1.5368, fit model time: 1.5356 2021-08-20 01:00:40,615 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 171, model transformed features: 15, total model time: 1.9204, fit model time: 1.9188 2021-08-20 01:00:40,617 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 152, model transformed features: 15, total model time: 2.1009, fit model time: 2.1 2021-08-20 01:00:40,619 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 1.7299, fit model time: 1.7289 2021-08-20 01:00:40,621 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 15, total model time: 1.6897, fit model time: 1.6887 2021-08-20 01:00:40,622 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 113, model transformed features: 15, total model time: 1.8996, fit model time: 1.898 2021-08-20 01:00:40,624 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 119, model transformed features: 15, total model time: 2.1811, fit model time: 2.1802 2021-08-20 01:00:41,708 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:00:41,829 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:00:41,855 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Experiment Progress: 0.443 % 2021-08-20 01:00:41,877 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Scored 3/598 models on 18 features. Last Scored [LIGHTGBM] 2021-08-20 01:00:41,881 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:00:41,883 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:00:41,885 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.638847 +/- 0.04907702 [Tournament: 1.638847 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:00:41,890 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:00:41,896 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:00:41,901 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:00:41,903 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:00:41,905 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:00:41,908 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:00:41,910 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:00:41,913 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:00:41,915 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:00:41,918 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:00:41,920 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:00:41,923 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:00:41,925 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:00:41,928 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Tuned 12/18 target transform tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:00:41,931 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:00:41,934 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:00:41,936 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Starting Iteration: 1 2021-08-20 01:00:41,939 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:00:42,275 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:00:43,229 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:00:43,238 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 2, 10) 2021-08-20 01:00:43,241 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:00:43,464 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:00:43,562 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:43,747 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:43,749 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:43,751 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:43,846 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:43,849 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:43,851 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:44,823 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.35691 seconds. 2021-08-20 01:00:44,836 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:00:44,839 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:00:44,890 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.27726 seconds. 2021-08-20 01:00:44,902 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:44,905 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:44,956 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 114 iterations: 114 2021-08-20 01:00:44,964 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.12436 seconds. 2021-08-20 01:00:44,966 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.13046 seconds. 2021-08-20 01:00:44,973 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:00:44,980 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07431 seconds. 2021-08-20 01:00:44,982 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08006 seconds. 2021-08-20 01:00:45,453 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:45,575 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:00:45,794 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:45,796 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:45,799 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:45,852 C: 34% D:996.4GB M:237.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:45,860 C: 34% D:996.4GB M:237.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:45,862 C: 34% D:996.4GB M:237.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:47,062 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.48685 seconds. 2021-08-20 01:00:47,072 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:00:47,074 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:00:47,094 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.63939 seconds. 2021-08-20 01:00:47,108 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:47,111 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:47,141 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:00:47,151 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07463 seconds. 2021-08-20 01:00:47,154 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08140 seconds. 2021-08-20 01:00:47,174 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:00:47,181 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06981 seconds. 2021-08-20 01:00:47,184 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07553 seconds. 2021-08-20 01:00:47,490 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:47,654 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:47,724 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:47,726 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:47,728 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:47,919 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:47,921 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:47,923 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:48,721 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.06680 seconds. 2021-08-20 01:00:48,732 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:48,735 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:48,799 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:00:48,805 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07047 seconds. 2021-08-20 01:00:48,807 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07605 seconds. 2021-08-20 01:00:49,371 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.88094 seconds. 2021-08-20 01:00:49,383 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:49,385 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:49,453 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 115 iterations: 115 2021-08-20 01:00:49,460 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07475 seconds. 2021-08-20 01:00:49,463 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07986 seconds. 2021-08-20 01:00:49,671 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:00:51,153 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 114, model transformed features: 10, total model time: 1.6989, fit model time: 1.6979 2021-08-20 01:00:51,159 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 10, total model time: 1.5977, fit model time: 1.5968 2021-08-20 01:00:51,161 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 10, total model time: 1.7788, fit model time: 1.7779 2021-08-20 01:00:51,163 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 10, total model time: 1.9626, fit model time: 1.9613 2021-08-20 01:00:51,165 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 105, model transformed features: 10, total model time: 1.3495, fit model time: 1.3486 2021-08-20 01:00:51,167 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 115, model transformed features: 10, total model time: 2.1755, fit model time: 2.1744 2021-08-20 01:00:51,500 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.8284 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:00:52,004 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Munge time: 0.9836 s, Train time: 6.4296 s, Score time: 1.5908 s 2021-08-20 01:00:52,057 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:00:52,871 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:00:53,087 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:53,213 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:53,348 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_2': 1, 'InteractionSub:X_0:X_3': -1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:53,350 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionMul:X_0:X_1': '0.50024', 'InteractionMul:X_0:X_2': '0.28716', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:53,352 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806', 'InteractionSub:X_0:X_3': '-0.10377'} 2021-08-20 01:00:53,473 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:53,475 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_3': '0.70155', 'InteractionAdd:X_1:X_3': '0.68494', 'InteractionMul:X_0:X_1': '0.50019', 'InteractionMul:X_0:X_3': '0.65001', 'InteractionMul:X_1:X_3': '0.63161', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:53,477 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:54,318 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.10347 seconds. 2021-08-20 01:00:54,330 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:54,333 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:54,413 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 87 iterations: 87 2021-08-20 01:00:54,418 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08497 seconds. 2021-08-20 01:00:54,420 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09112 seconds. 2021-08-20 01:00:54,430 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.34609 seconds. 2021-08-20 01:00:54,441 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:54,443 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:54,511 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:00:54,517 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07348 seconds. 2021-08-20 01:00:54,520 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07895 seconds. 2021-08-20 01:00:54,741 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:54,903 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:55,025 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:55,027 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionAdd:X_0:X_3': '0.70521', 'InteractionAdd:X_1:X_3': '0.67883', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionMul:X_0:X_3': '0.64780', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:55,029 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:55,160 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:55,162 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionAdd:X_0:X_3': '0.69729', 'InteractionAdd:X_1:X_3': '0.69174', 'InteractionMul:X_0:X_3': '0.63628', 'InteractionMul:X_1:X_3': '0.64516', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:55,165 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:55,900 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.15916 seconds. 2021-08-20 01:00:55,911 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:55,914 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:55,987 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 109 iterations: 109 2021-08-20 01:00:55,992 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07817 seconds. 2021-08-20 01:00:55,995 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08330 seconds. 2021-08-20 01:00:56,106 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.20337 seconds. 2021-08-20 01:00:56,116 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:56,119 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:56,185 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 101 iterations: 101 2021-08-20 01:00:56,192 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07238 seconds. 2021-08-20 01:00:56,196 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07730 seconds. 2021-08-20 01:00:56,325 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:56,522 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:56,640 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_2:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_2:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:56,643 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_2:X_3': '0.42358', 'InteractionMul:X_0:X_1': '0.49996', 'InteractionMul:X_0:X_3': '0.63480', 'InteractionMul:X_2:X_3': '0.37896', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:56,645 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:56,765 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:56,767 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_3': '0.67252', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_0:X_3': '0.66064', 'InteractionMul:X_1:X_3': '0.62524', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:56,769 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:57,508 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.18009 seconds. 2021-08-20 01:00:57,519 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:57,522 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:57,590 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 77 iterations: 77 2021-08-20 01:00:57,595 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07392 seconds. 2021-08-20 01:00:57,598 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07932 seconds. 2021-08-20 01:00:57,777 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.25098 seconds. 2021-08-20 01:00:57,786 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:57,788 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:57,865 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:00:57,874 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08534 seconds. 2021-08-20 01:00:57,877 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09207 seconds. 2021-08-20 01:00:58,043 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:00:59,571 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 87, model transformed features: 15, total model time: 1.3989, fit model time: 1.3979 2021-08-20 01:00:59,577 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 15, total model time: 1.638, fit model time: 1.637 2021-08-20 01:00:59,578 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 109, model transformed features: 15, total model time: 1.4355, fit model time: 1.4347 2021-08-20 01:00:59,580 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 101, model transformed features: 15, total model time: 1.5034, fit model time: 1.5025 2021-08-20 01:00:59,582 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 77, model transformed features: 15, total model time: 1.4653, fit model time: 1.464 2021-08-20 01:00:59,584 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 15, total model time: 1.5284, fit model time: 1.5275 2021-08-20 01:00:59,931 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.7416 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:00,456 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Munge time: 0.8342 s, Train time: 5.1664 s, Score time: 1.6316 s 2021-08-20 01:01:00,629 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:01:00,786 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:01:00,812 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Experiment Progress: 0.59 % 2021-08-20 01:01:00,835 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Scored 4/598 models on 40 features. Last Scored [LIGHTGBM] 2021-08-20 01:01:00,841 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:01:00,844 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:01:00,846 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.741646 +/- 0.05843223 [Tournament: 1.741646 Model: LIGHTGBM Feature Cost: 22] 2021-08-20 01:01:00,852 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:01:00,860 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:01:00,865 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:01:00,868 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:01:00,870 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:01:00,872 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:01:00,875 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:01:00,878 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:01:00,880 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:01:00,883 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:01:00,885 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:01:00,888 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:01:00,891 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:01:00,895 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Tuned 18/18 target transform tuning models. Tuned [LIGHTGBM] Tuning [] 2021-08-20 01:01:00,983 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:01:01,086 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:01:01,123 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Target transform tuning leaderboard (score_f_name=RMSE): 2021-08-20 01:01:01,124 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:01,126 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+-----------------------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+------------+-----------+--------+ 2021-08-20 01:01:01,128 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | transformer | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:01:01,130 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | |-------------+--------------+----------------+--------------------+-----------------------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+------------+-----------+--------| 2021-08-20 01:01:01,132 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | 1 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.63852 | 0.0491097 | 11.5146 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | TargetTuning | 1.63852 | 1.63852 | 0.0491097 | 1.63852 | 1 | 1 | 11 | 100 | 17 | False | False | 0 | 0 | 1 | 1 | 3478.51 | 0 | * | + | 2021-08-20 01:01:01,134 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | 0 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity | 1.63885 | 0.049077 | 11.4943 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | TargetTuning | 1.63885 | 1.63885 | 0.049077 | 1.63885 | 0.998238 | 1 | 11 | 100 | 17 | False | False | 0 | 0 | 0.999799 | 0.999799 | 3478.51 | 0.00671663 | | + | 2021-08-20 01:01:01,136 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | 2 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_center | 1.74165 | 0.0584322 | 8.9637 | 99 | 22 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, -1, 1, 1, 0, -1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | TargetTuning | 1.74165 | 1.74165 | 0.0584322 | 1.74165 | 0.778465 | 0.733333 | 11 | 100 | 22 | False | False | 0 | 0 | 0.940786 | 0.940786 | 2550.9 | 2.09997 | | | 2021-08-20 01:01:01,138 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+-----------------------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+------------+-----------+--------+ 2021-08-20 01:01:01,172 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Target transform search: end : Duration: 389.6202 s 2021-08-20 01:01:01,354 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Target transform: TargetTransformer_identity_noclip 2021-08-20 01:01:01,359 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Model and feature tuning... 2021-08-20 01:01:01,495 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Forced tuning of these ON models: [] 2021-08-20 01:01:03,141 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,355 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,546 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,719 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,922 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,124 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,328 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,500 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,748 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=False accuracy=7 interpretability=8 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:05,244 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=False accuracy=7 interpretability=11 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:05,792 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=True accuracy=7 interpretability=8 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:06,039 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=True accuracy=2 interpretability=8 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:06,258 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=True accuracy=7 interpretability=11 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:06,481 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting 3 modified default individuals with boosters: {'lightgbm'} 2021-08-20 01:01:06,483 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting 1 original best individual 2021-08-20 01:01:07,358 C: 70% D:996.2GB M:235.5GB NODE:LOCAL1 7646 INFO | best individual has sim_score=0 for H2O.ai brain caching /opt/h2oai/dai/tmp/n/H2O.ai_brain/best_individual.4b19926e-ffa8-11eb-b231-0242c0a8fe02.ret_353750d7-600d-42d7-afbe-5cf13c7df769.pickle 2021-08-20 01:01:08,007 C: 70% D:996.2GB M:235.5GB NODE:LOCAL1 7646 INFO | best individual has sim_score=0 for H2O.ai brain caching /opt/h2oai/dai/tmp/n/H2O.ai_brain/best_individual.465e7758-ffa3-11eb-b231-0242c0a8fe02.ret_ad1c4d35-b4c9-4b6a-b143-7b45d9ac6210.pickle 2021-08-20 01:01:08,664 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Brain cache found 2 matching individuals and will use best 2 individuals for this experiment. 2021-08-20 01:01:08,670 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Brain original scores [which will be re-scored, if not restarting or have different scorer or features changed]: 2021-08-20 01:01:08,672 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ['1.532119 +/- 0.0848579 [RMSE] using LightGBMModel', '1.564021 +/- 0.107501 [RMSE] using LightGBMModel'] 2021-08-20 01:01:08,674 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Brain new scores [nan means needs to be re-scored]: 2021-08-20 01:01:08,676 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ['nan +/- nan [RMSE] using LightGBMModel', 'nan +/- nan [RMSE] using LightGBMModel'] 2021-08-20 01:01:08,683 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Parameter & feature tuning iterations: 5 2021-08-20 01:01:08,686 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Tuned 0/54 Parameter & feature tuning models. Tuning [LIGHTGBM] 2021-08-20 01:01:08,688 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:08,691 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:08,693 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Starting Iteration: 2 2021-08-20 01:01:08,696 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:08,770 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Engineering features (for 0/2 base individual models out of 0 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:08,778 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 0 munging tasks out of 0 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:08,799 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 2 training tasks out of 0 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:09,068 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:09,530 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Munge time: 0.0234 s, Train time: 0.0159 s, Score time: 0.0287 s 2021-08-20 01:01:09,568 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Engineering features (for 0/2 base individual models out of 0 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:09,577 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 0 munging tasks out of 0 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:09,603 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 2 training tasks out of 0 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:09,896 C: 71% D:996.1GB M:236.3GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:10,368 C: 71% D:996.1GB M:236.3GB NODE:LOCAL1 7646 INFO | Munge time: 0.0279 s, Train time: 0.0173 s, Score time: 0.0324 s 2021-08-20 01:01:10,543 C: 71% D:996.1GB M:236.3GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:01:10,898 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:01:10,919 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.1 % 2021-08-20 01:01:10,932 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Scored 21/598 models on 45 features. Last Scored [] 2021-08-20 01:01:10,939 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:01:10,941 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:01:10,948 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:01:10,954 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:01:10,959 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:01:10,961 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:01:10,963 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:01:10,966 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:01:10,968 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:01:10,970 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:01:10,973 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:01:10,975 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:01:10,977 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:01:10,980 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:01:10,982 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:01:10,985 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Tuned 0/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:01:10,988 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:10,991 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:10,993 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Starting Iteration: 3 2021-08-20 01:01:10,995 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:11,207 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Pre-pruning 1 gene(s) from 11 active base genes 2021-08-20 01:01:11,430 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Pre-pruning 1 gene(s) from 11 active base genes 2021-08-20 01:01:11,572 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:13,514 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 INFO | Completed 120 munging tasks out of 120 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:13,529 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:01:13,533 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:13,538 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348886', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 01:01:13,543 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:13,830 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:13,952 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:14,173 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:14,177 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:14,179 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:14,234 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:14,236 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:14,239 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:15,079 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.25012 seconds. 2021-08-20 01:01:15,094 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:15,098 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:15,187 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 79 iterations: 79 2021-08-20 01:01:15,209 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.11127 seconds. 2021-08-20 01:01:15,212 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.11880 seconds. 2021-08-20 01:01:15,614 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:15,953 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:15,955 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:15,958 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:16,057 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 2.10157 seconds. 2021-08-20 01:01:16,075 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:16,079 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:16,158 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:01:16,167 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08776 seconds. 2021-08-20 01:01:16,170 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09557 seconds. 2021-08-20 01:01:16,610 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:16,984 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.37286 seconds. 2021-08-20 01:01:17,009 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:17,014 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:17,047 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:17,049 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:17,053 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:17,109 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:01:17,154 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.14022 seconds. 2021-08-20 01:01:17,166 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.14987 seconds. 2021-08-20 01:01:17,804 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:18,486 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:18,503 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:18,505 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:19,102 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 2.48831 seconds. 2021-08-20 01:01:19,120 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:19,124 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:19,222 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 89 iterations: 89 2021-08-20 01:01:19,231 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.10632 seconds. 2021-08-20 01:01:19,236 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.11445 seconds. 2021-08-20 01:01:19,518 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.71451 seconds. 2021-08-20 01:01:19,541 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:19,545 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:19,651 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 83 iterations: 83 2021-08-20 01:01:19,714 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.16598 seconds. 2021-08-20 01:01:19,718 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.17664 seconds. 2021-08-20 01:01:19,747 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:20,113 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:20,116 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:20,119 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:20,124 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:20,470 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:20,474 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:20,479 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:21,038 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.29348 seconds. 2021-08-20 01:01:21,052 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:21,056 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:21,130 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:01:21,138 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08159 seconds. 2021-08-20 01:01:21,140 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08869 seconds. 2021-08-20 01:01:21,407 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.28186 seconds. 2021-08-20 01:01:21,423 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:21,426 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:21,513 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 63 iterations: 63 2021-08-20 01:01:21,521 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.09318 seconds. 2021-08-20 01:01:21,524 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.10068 seconds. 2021-08-20 01:01:21,555 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:21,920 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:21,928 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:21,944 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:21,987 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:22,457 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:22,465 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:22,467 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:22,827 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.27080 seconds. 2021-08-20 01:01:22,845 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:22,850 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:22,930 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 68 iterations: 68 2021-08-20 01:01:22,941 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.09195 seconds. 2021-08-20 01:01:22,944 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.10069 seconds. 2021-08-20 01:01:23,366 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:23,427 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.44246 seconds. 2021-08-20 01:01:23,443 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:23,447 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:23,519 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 77 iterations: 77 2021-08-20 01:01:23,525 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07823 seconds. 2021-08-20 01:01:23,527 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08529 seconds. 2021-08-20 01:01:23,739 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:23,741 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:23,743 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:23,793 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:23,931 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:24,261 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:24,265 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:24,285 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:24,729 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.36285 seconds. 2021-08-20 01:01:24,746 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:24,751 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:24,836 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:01:24,844 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.09317 seconds. 2021-08-20 01:01:24,849 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.10141 seconds. 2021-08-20 01:01:25,028 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.09649 seconds. 2021-08-20 01:01:25,040 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:25,043 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:25,125 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 71 iterations: 71 2021-08-20 01:01:25,133 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08941 seconds. 2021-08-20 01:01:25,137 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09616 seconds. 2021-08-20 01:01:25,291 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:25,668 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:25,671 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:25,674 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:26,392 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.10185 seconds. 2021-08-20 01:01:26,403 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:26,406 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:26,474 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 59 iterations: 59 2021-08-20 01:01:26,479 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07315 seconds. 2021-08-20 01:01:26,482 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.07880 seconds. 2021-08-20 01:01:26,679 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:28,558 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 79, model transformed features: 9, total model time: 1.6279, fit model time: 1.627 2021-08-20 01:01:28,566 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 100, model transformed features: 9, total model time: 2.4083, fit model time: 2.4073 2021-08-20 01:01:28,568 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 97, model transformed features: 9, total model time: 1.8189, fit model time: 1.8177 2021-08-20 01:01:28,570 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 89, model transformed features: 9, total model time: 2.8839, fit model time: 2.8829 2021-08-20 01:01:28,572 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 83, model transformed features: 9, total model time: 2.2429, fit model time: 2.2421 2021-08-20 01:01:28,574 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 9, total model time: 1.6186, fit model time: 1.6178 2021-08-20 01:01:28,576 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 63, model transformed features: 9, total model time: 1.6421, fit model time: 1.641 2021-08-20 01:01:28,578 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 68, model transformed features: 9, total model time: 1.609, fit model time: 1.6081 2021-08-20 01:01:28,580 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 77, model transformed features: 9, total model time: 1.7876, fit model time: 1.7867 2021-08-20 01:01:28,582 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 84, model transformed features: 9, total model time: 1.7373, fit model time: 1.7358 2021-08-20 01:01:28,584 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 71, model transformed features: 9, total model time: 1.4014, fit model time: 1.4006 2021-08-20 01:01:28,586 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 59, model transformed features: 9, total model time: 1.4244, fit model time: 1.4233 2021-08-20 01:01:28,976 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=2.2084 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:01:29,029 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=2.9734 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:01:29,809 C: 68% D:995.5GB M:235.6GB NODE:LOCAL1 7646 INFO | Munge time: 1.9937 s, Train time: 13.1364 s, Score time: 2.0284 s 2021-08-20 01:01:29,884 C: 68% D:995.5GB M:235.6GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:31,807 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 INFO | Completed 120 munging tasks out of 120 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:32,108 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:32,170 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:32,465 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:32,468 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:32,472 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:01:32,608 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:32,611 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:32,615 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:01:33,508 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.39938 seconds. 2021-08-20 01:01:33,525 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:33,529 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:33,607 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 81 iterations: 81 2021-08-20 01:01:33,615 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.08567 seconds. 2021-08-20 01:01:33,621 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.09522 seconds. 2021-08-20 01:01:34,091 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:34,163 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.99272 seconds. 2021-08-20 01:01:34,186 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:34,191 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:34,287 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:01:34,306 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.11379 seconds. 2021-08-20 01:01:34,310 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.12360 seconds. 2021-08-20 01:01:34,434 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:34,439 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:34,441 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:01:34,767 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:35,118 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:35,121 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:35,124 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:01:35,360 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.26911 seconds. 2021-08-20 01:01:35,374 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:35,378 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:35,461 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 86 iterations: 86 2021-08-20 01:01:35,471 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09297 seconds. 2021-08-20 01:01:35,486 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10038 seconds. 2021-08-20 01:01:35,908 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:36,017 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.24962 seconds. 2021-08-20 01:01:36,029 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:36,032 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:36,133 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 77 iterations: 77 2021-08-20 01:01:36,145 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.10787 seconds. 2021-08-20 01:01:36,150 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.11865 seconds. 2021-08-20 01:01:36,260 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:36,263 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:36,266 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:01:36,531 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:36,870 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:36,873 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:36,875 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:01:37,125 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.21573 seconds. 2021-08-20 01:01:37,138 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:37,141 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:37,214 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 70 iterations: 70 2021-08-20 01:01:37,228 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08487 seconds. 2021-08-20 01:01:37,231 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.09262 seconds. 2021-08-20 01:01:37,637 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:38,072 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.53999 seconds. 2021-08-20 01:01:38,085 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:38,096 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:38,186 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:01:38,201 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.11250 seconds. 2021-08-20 01:01:38,205 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.11950 seconds. 2021-08-20 01:01:38,595 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:38,653 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:38,660 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:38,662 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:01:39,034 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:39,039 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:39,043 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:01:40,372 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.77109 seconds. 2021-08-20 01:01:40,390 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:40,393 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:40,413 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 2.77110 seconds. 2021-08-20 01:01:40,440 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:40,443 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:40,480 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 92 iterations: 92 2021-08-20 01:01:40,488 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09350 seconds. 2021-08-20 01:01:40,492 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10114 seconds. 2021-08-20 01:01:40,517 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 131 iterations: 131 2021-08-20 01:01:40,524 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.08070 seconds. 2021-08-20 01:01:40,528 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.08774 seconds. 2021-08-20 01:01:40,874 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:41,067 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:41,200 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:41,202 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:41,204 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:01:41,364 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:41,367 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:41,369 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:01:41,387 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 5.6GB, since last ping: 5.5MB/s. CPU memory usage: 467.0MB, max: 893.7MB CPU: 249% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 21 (Disk: Read: 0B/s Write: 290.0kB/s Size: 2.7MB) (Connections: 58 Fds: 317 WinHandles: 0 Threads: 39 Maps: 4016 WinOpenFiles: 0) (System-Wide CPU: User: 67% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 22 DAIprocs: 70) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_3_batch_2-3_for_pop_size:_8)_train-training_xgb_indiv_1_fold_4] 2021-08-20 01:01:42,361 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.48468 seconds. 2021-08-20 01:01:42,377 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:42,380 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:42,450 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:01:42,458 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07748 seconds. 2021-08-20 01:01:42,462 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08419 seconds. 2021-08-20 01:01:42,741 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:42,771 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.70190 seconds. 2021-08-20 01:01:42,787 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:42,791 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:42,861 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:42,884 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:01:42,893 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.10255 seconds. 2021-08-20 01:01:42,896 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.11008 seconds. 2021-08-20 01:01:43,127 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:43,129 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:43,132 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:01:43,277 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:43,695 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:43,702 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:43,704 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:01:44,073 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.21056 seconds. 2021-08-20 01:01:44,090 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:44,092 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:44,178 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 01:01:44,186 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09485 seconds. 2021-08-20 01:01:44,189 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10242 seconds. 2021-08-20 01:01:45,149 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.87076 seconds. 2021-08-20 01:01:45,163 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:45,167 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:45,249 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 147 iterations: 147 2021-08-20 01:01:45,264 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09624 seconds. 2021-08-20 01:01:45,268 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10446 seconds. 2021-08-20 01:01:45,513 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:47,539 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 81, model transformed features: 13, total model time: 1.7657, fit model time: 1.7646 2021-08-20 01:01:47,546 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 13, total model time: 2.3801, fit model time: 2.379 2021-08-20 01:01:47,551 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 86, model transformed features: 13, total model time: 1.617, fit model time: 1.6161 2021-08-20 01:01:47,553 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 77, model transformed features: 13, total model time: 1.6219, fit model time: 1.621 2021-08-20 01:01:47,555 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 70, model transformed features: 13, total model time: 1.5386, fit model time: 1.5375 2021-08-20 01:01:47,557 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 13, total model time: 1.9091, fit model time: 1.9077 2021-08-20 01:01:47,558 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 92, model transformed features: 13, total model time: 2.1162, fit model time: 2.1151 2021-08-20 01:01:47,570 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 131, model transformed features: 13, total model time: 3.1048, fit model time: 3.1034 2021-08-20 01:01:47,572 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 108, model transformed features: 13, total model time: 1.7765, fit model time: 1.7754 2021-08-20 01:01:47,574 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 13, total model time: 2.0376, fit model time: 2.0365 2021-08-20 01:01:47,576 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 13, total model time: 1.5176, fit model time: 1.5163 2021-08-20 01:01:47,578 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 147, model transformed features: 13, total model time: 2.2165, fit model time: 2.2152 2021-08-20 01:01:47,960 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=2.0802 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:48,024 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:48,652 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Munge time: 1.9537 s, Train time: 13.6941 s, Score time: 2.1724 s 2021-08-20 01:01:48,812 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:01:49,170 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:01:49,224 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.39 % 2021-08-20 01:01:49,265 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Scored 23/598 models on 59 features. Last Scored [LIGHTGBM] 2021-08-20 01:01:49,275 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:01:49,278 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:01:49,280 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:01:49,282 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 2 : 2.080228 +/- 0.03523514 [Tournament: 2.080228 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:01:49,289 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:01:49,298 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:01:49,306 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:01:49,309 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:01:49,313 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:01:49,317 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:01:49,320 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:01:49,324 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:01:49,328 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:01:49,331 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:01:49,335 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:01:49,338 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:01:49,341 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:01:49,346 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Tuned 12/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:01:49,350 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:49,353 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:49,356 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Starting Iteration: 4 2021-08-20 01:01:49,360 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:49,668 C: 75% D:994.9GB M:232.4GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:01:50,548 C: 75% D:994.9GB M:232.4GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:01:51,373 C: 74% D:994.9GB M:235.6GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:53,719 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:53,729 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:01:53,733 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:53,737 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 01:01:53,741 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:54,644 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:54,648 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:01:54,955 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:54,961 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:54,963 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:54,977 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:54,979 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:54,982 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:55,558 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.91391 seconds. 2021-08-20 01:01:55,575 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:55,577 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:55,659 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 164 iterations: 164 2021-08-20 01:01:55,667 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08816 seconds. 2021-08-20 01:01:55,670 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09559 seconds. 2021-08-20 01:01:55,682 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.03621 seconds. 2021-08-20 01:01:55,694 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:01:55,697 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:01:55,765 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 196 iterations: 196 2021-08-20 01:01:55,772 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07472 seconds. 2021-08-20 01:01:55,775 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08094 seconds. 2021-08-20 01:01:56,038 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:56,238 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:01:56,372 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:56,374 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:56,377 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:56,544 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:56,546 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:56,550 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:56,910 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.87272 seconds. 2021-08-20 01:01:56,920 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:56,923 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:57,006 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 151 iterations: 151 2021-08-20 01:01:57,012 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08868 seconds. 2021-08-20 01:01:57,015 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09428 seconds. 2021-08-20 01:01:57,054 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 0.81610 seconds. 2021-08-20 01:01:57,067 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:01:57,071 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:01:57,150 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 161 iterations: 161 2021-08-20 01:01:57,157 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08586 seconds. 2021-08-20 01:01:57,161 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09311 seconds. 2021-08-20 01:01:57,389 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:57,570 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:57,694 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:57,696 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:57,698 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:57,870 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:57,874 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:57,878 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:58,256 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.86758 seconds. 2021-08-20 01:01:58,273 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:58,275 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:58,361 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:01:58,372 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09502 seconds. 2021-08-20 01:01:58,377 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.10262 seconds. 2021-08-20 01:01:58,426 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.85666 seconds. 2021-08-20 01:01:58,437 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:58,440 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:58,521 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 167 iterations: 167 2021-08-20 01:01:58,533 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09144 seconds. 2021-08-20 01:01:58,536 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09825 seconds. 2021-08-20 01:01:58,745 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:01:58,950 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:59,045 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:59,049 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:59,051 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:59,238 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:59,244 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:59,247 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:00,286 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.53947 seconds. 2021-08-20 01:02:00,302 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:02:00,307 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:02:00,399 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:02:00,405 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09860 seconds. 2021-08-20 01:02:00,407 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.10634 seconds. 2021-08-20 01:02:00,646 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.68860 seconds. 2021-08-20 01:02:00,669 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:00,676 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:00,764 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 01:02:00,770 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09615 seconds. 2021-08-20 01:02:00,773 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.10567 seconds. 2021-08-20 01:02:00,791 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:01,102 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:01,106 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:02:01,109 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:01,163 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:02:01,490 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:01,496 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:02:01,497 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:02,222 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.42997 seconds. 2021-08-20 01:02:02,234 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:02,237 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:02,307 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 01:02:02,316 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07708 seconds. 2021-08-20 01:02:02,319 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08409 seconds. 2021-08-20 01:02:02,462 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.29963 seconds. 2021-08-20 01:02:02,473 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:02:02,476 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:02:02,559 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:02:02,567 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09012 seconds. 2021-08-20 01:02:02,571 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09655 seconds. 2021-08-20 01:02:02,715 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:03,009 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:03,012 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:02:03,015 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:03,019 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:03,367 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:02:03,369 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:02:03,372 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:04,043 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.32641 seconds. 2021-08-20 01:02:04,059 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:04,063 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:04,191 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 01:02:04,227 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.16411 seconds. 2021-08-20 01:02:04,230 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.17221 seconds. 2021-08-20 01:02:04,786 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.73307 seconds. 2021-08-20 01:02:04,839 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:04,843 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:04,935 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:02:04,958 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.11380 seconds. 2021-08-20 01:02:04,960 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.12178 seconds. 2021-08-20 01:02:05,262 C: 88% D:994.3GB M:233.7GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:02:07,310 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 164, model transformed features: 10, total model time: 1.6802, fit model time: 1.6793 2021-08-20 01:02:07,318 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 196, model transformed features: 10, total model time: 1.9729, fit model time: 1.9719 2021-08-20 01:02:07,320 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 151, model transformed features: 10, total model time: 1.1765, fit model time: 1.1757 2021-08-20 01:02:07,322 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 161, model transformed features: 10, total model time: 1.1373, fit model time: 1.1365 2021-08-20 01:02:07,324 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 150, model transformed features: 10, total model time: 1.2223, fit model time: 1.2214 2021-08-20 01:02:07,326 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 167, model transformed features: 10, total model time: 1.1826, fit model time: 1.1812 2021-08-20 01:02:07,328 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 1.8762, fit model time: 1.8749 2021-08-20 01:02:07,330 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 2.0619, fit model time: 2.0605 2021-08-20 01:02:07,332 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 1.7478, fit model time: 1.7469 2021-08-20 01:02:07,334 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 1.6617, fit model time: 1.66 2021-08-20 01:02:07,336 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 1.7665, fit model time: 1.7652 2021-08-20 01:02:07,338 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 2.2315, fit model time: 2.2304 2021-08-20 01:02:07,745 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.7663 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:02:07,790 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.8349 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:02:08,686 C: 70% D:994.2GB M:233.0GB NODE:LOCAL1 7646 INFO | Munge time: 2.3927 s, Train time: 11.5141 s, Score time: 2.2382 s 2021-08-20 01:02:08,754 C: 70% D:994.2GB M:233.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:02:09,662 C: 70% D:994.2GB M:233.0GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:02:09,911 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:10,061 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:10,180 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:10,184 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_0:X_3': '0.69742', 'InteractionMul:X_0:X_1': '0.50024', 'InteractionMul:X_0:X_3': '0.63392', 'InteractionMul:X_1:X_3': '0.63112', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:02:10,188 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:10,365 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:10,368 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_0:X_3': '0.70155', 'InteractionMul:X_0:X_1': '0.50019', 'InteractionMul:X_0:X_3': '0.65001', 'InteractionMul:X_1:X_3': '0.63161', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:02:10,371 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:10,762 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 0.70044 seconds. 2021-08-20 01:02:10,775 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:10,779 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:10,860 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 129 iterations: 129 2021-08-20 01:02:10,866 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08715 seconds. 2021-08-20 01:02:10,868 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09484 seconds. 2021-08-20 01:02:10,871 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 0.96006 seconds. 2021-08-20 01:02:10,881 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:10,884 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:10,949 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 143 iterations: 143 2021-08-20 01:02:10,966 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07035 seconds. 2021-08-20 01:02:10,968 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07585 seconds. 2021-08-20 01:02:11,214 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:11,356 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:11,475 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:11,477 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionAdd:X_0:X_3': '0.70521', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionMul:X_0:X_3': '0.64780', 'InteractionMul:X_1:X_3': '0.63433', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:02:11,479 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:11,632 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:11,635 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionAdd:X_0:X_3': '0.69729', 'InteractionAdd:X_1:X_3': '0.69174', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionMul:X_1:X_3': '0.64516', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:02:11,639 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:12,077 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 0.86302 seconds. 2021-08-20 01:02:12,093 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:12,095 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:12,157 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 112 iterations: 112 2021-08-20 01:02:12,163 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07210 seconds. 2021-08-20 01:02:12,165 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07778 seconds. 2021-08-20 01:02:12,201 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 0.84453 seconds. 2021-08-20 01:02:12,211 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:12,214 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:12,298 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 172 iterations: 172 2021-08-20 01:02:12,304 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.08955 seconds. 2021-08-20 01:02:12,306 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.09465 seconds. 2021-08-20 01:02:12,488 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:12,648 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:12,746 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:12,749 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_0:X_3': '0.69614', 'InteractionMul:X_0:X_1': '0.49996', 'InteractionMul:X_0:X_3': '0.63480', 'InteractionMul:X_1:X_3': '0.62623', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:02:12,751 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:12,966 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:02:12,968 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_0:X_3': '0.71067', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_0:X_3': '0.66064', 'InteractionMul:X_1:X_3': '0.62524', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:02:12,970 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:13,199 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 0.71178 seconds. 2021-08-20 01:02:13,210 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:13,212 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:13,276 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 141 iterations: 141 2021-08-20 01:02:13,280 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.06803 seconds. 2021-08-20 01:02:13,282 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07266 seconds. 2021-08-20 01:02:13,627 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:13,760 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.11154 seconds. 2021-08-20 01:02:13,771 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:13,773 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:13,845 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:02:13,850 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07695 seconds. 2021-08-20 01:02:13,852 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08232 seconds. 2021-08-20 01:02:13,874 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:13,876 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:02:13,878 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:14,196 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:14,468 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:14,475 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:02:14,477 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:15,319 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.69173 seconds. 2021-08-20 01:02:15,331 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:15,333 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:15,400 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:02:15,409 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07490 seconds. 2021-08-20 01:02:15,414 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08045 seconds. 2021-08-20 01:02:15,756 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:15,985 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.78711 seconds. 2021-08-20 01:02:15,996 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:15,999 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:16,072 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:02:16,081 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08129 seconds. 2021-08-20 01:02:16,084 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08714 seconds. 2021-08-20 01:02:16,412 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:16,569 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:16,572 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:02:16,575 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:16,771 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:16,778 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:02:16,779 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:17,716 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.95910 seconds. 2021-08-20 01:02:17,727 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:17,729 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:17,817 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:02:17,826 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.09515 seconds. 2021-08-20 01:02:17,831 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.10187 seconds. 2021-08-20 01:02:17,860 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.44834 seconds. 2021-08-20 01:02:17,871 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:17,873 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:17,942 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:02:17,950 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07561 seconds. 2021-08-20 01:02:17,953 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08171 seconds. 2021-08-20 01:02:18,276 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:18,452 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:18,534 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:18,536 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:02:18,539 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:18,723 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:02:18,726 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:02:18,728 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:19,617 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.34085 seconds. 2021-08-20 01:02:19,628 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:19,630 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:19,675 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.22154 seconds. 2021-08-20 01:02:19,686 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:19,688 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:19,704 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:02:19,714 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08276 seconds. 2021-08-20 01:02:19,716 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08814 seconds. 2021-08-20 01:02:19,755 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 113 iterations: 113 2021-08-20 01:02:19,762 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07354 seconds. 2021-08-20 01:02:19,764 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07875 seconds. 2021-08-20 01:02:19,957 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:02:21,641 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 129, model transformed features: 15, total model time: 1.0079, fit model time: 1.0069 2021-08-20 01:02:21,649 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 143, model transformed features: 15, total model time: 1.2544, fit model time: 1.2535 2021-08-20 01:02:21,651 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 112, model transformed features: 15, total model time: 1.1386, fit model time: 1.1377 2021-08-20 01:02:21,653 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 172, model transformed features: 15, total model time: 1.1413, fit model time: 1.1404 2021-08-20 01:02:21,655 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 141, model transformed features: 15, total model time: 0.97604, fit model time: 0.97483 2021-08-20 01:02:21,657 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 139, model transformed features: 15, total model time: 1.3805, fit model time: 1.3797 2021-08-20 01:02:21,660 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 152, model transformed features: 15, total model time: 1.9884, fit model time: 1.987 2021-08-20 01:02:21,662 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 171, model transformed features: 15, total model time: 2.1022, fit model time: 2.101 2021-08-20 01:02:21,664 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 2.2804, fit model time: 2.2792 2021-08-20 01:02:21,666 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 125, model transformed features: 15, total model time: 1.7206, fit model time: 1.7196 2021-08-20 01:02:21,668 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 119, model transformed features: 15, total model time: 1.6258, fit model time: 1.6245 2021-08-20 01:02:21,670 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 113, model transformed features: 15, total model time: 1.4878, fit model time: 1.4869 2021-08-20 01:02:21,995 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6909 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:02:22,028 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:02:22,860 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Munge time: 0.9305 s, Train time: 10.2872 s, Score time: 1.8307 s 2021-08-20 01:02:23,020 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:02:23,368 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:02:23,402 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.69 % 2021-08-20 01:02:23,427 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Scored 25/598 models on 80 features. Last Scored [LIGHTGBM] 2021-08-20 01:02:23,434 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:02:23,436 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638488 +/- 0.04910973 [Tournament: 1.638488 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:02:23,438 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.690918 +/- 0.05417363 [Tournament: 1.690918 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:02:23,444 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638488 RMSE 2021-08-20 01:02:23,450 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:02:23,455 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:02:23,458 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:02:23,460 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:02:23,463 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:02:23,465 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:02:23,468 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:02:23,470 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:02:23,472 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:02:23,475 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:02:23,477 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:02:23,479 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:02:23,483 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Tuned 24/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:02:23,485 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:02:23,488 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:02:23,491 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Starting Iteration: 5 2021-08-20 01:02:23,493 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:02:23,733 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:02:24,547 C: 24% D:993.9GB M:237.2GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:02:25,274 C: 24% D:993.9GB M:237.2GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:02:26,909 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:02:26,918 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:02:26,921 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:02:26,924 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 01:02:26,926 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:02:27,197 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:02:27,316 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:48,153 C: 31% D:994.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 8.5GB, since last ping: 5.7MB/s. CPU memory usage: 614.4MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.2kB/s Size: 3.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 14% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 2 DAIprocs: 50) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_0_fold_2] 2021-08-20 01:03:55,290 C: 66% D:993.3GB M:237.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 9.4GB, since last ping: 31.3kB/s. CPU memory usage: 616.6MB, max: 894.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.4kB/s Size: 3.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 56% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 2 DAIprocs: 53) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_0_fold_2] 2021-08-20 01:04:11,403 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:11,410 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:04:11,411 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:11,960 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 104.64233 seconds. 2021-08-20 01:04:11,973 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:04:11,977 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:04:12,066 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:04:12,077 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09862 seconds. 2021-08-20 01:04:12,082 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.10761 seconds. 2021-08-20 01:04:12,382 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 2 3 and Completed 1 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:04:12,385 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:04:12,388 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Time: 105.365 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 8, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.3, 'subsample': 0.8, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 8, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None} 2021-08-20 01:04:12,391 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:04:12,393 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | Time: 105.365 s: LIGHTGBM 2021-08-20 01:04:12,527 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:04:12,600 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:12,602 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:04:12,605 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:13,200 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 106.00403 seconds. 2021-08-20 01:04:13,212 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:04:13,214 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:04:13,280 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:04:13,287 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07193 seconds. 2021-08-20 01:04:13,289 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07699 seconds. 2021-08-20 01:04:13,635 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:04:13,643 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:13,646 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:04:13,648 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:14,070 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.54288 seconds. 2021-08-20 01:04:14,081 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:04:14,083 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:04:14,151 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:04:14,156 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07305 seconds. 2021-08-20 01:04:14,159 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07801 seconds. 2021-08-20 01:04:14,547 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:04:14,586 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:14,589 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:04:14,591 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:15,024 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.38729 seconds. 2021-08-20 01:04:15,035 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:04:15,037 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:04:15,104 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:04:15,111 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07268 seconds. 2021-08-20 01:04:15,113 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07858 seconds. 2021-08-20 01:04:15,445 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:05:02,042 C: 67% D:990.3GB M:235.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 12.7GB, since last ping: 29.1MB/s. CPU memory usage: 615.3MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.0kB/s Size: 3.0MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4005 WinOpenFiles: 0) (System-Wide CPU: User: 57% Nice: 0% System: 7% Wait: 3% DAIActiveprocs: 1 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_0] 2021-08-20 01:05:33,774 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:05:33,782 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:05:33,784 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:05:34,265 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 79.71798 seconds. 2021-08-20 01:05:34,275 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:05:34,277 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:05:34,351 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:05:34,358 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07975 seconds. 2021-08-20 01:05:34,360 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08452 seconds. 2021-08-20 01:05:34,621 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 0 7 and Completed 5 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:05:34,624 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:05:34,627 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Time: 79.3109 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 8, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.3, 'subsample': 0.8, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 8, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None} 2021-08-20 01:05:34,630 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:05:34,632 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | Time: 79.3109 s: LIGHTGBM 2021-08-20 01:05:34,646 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:05:34,648 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:05:34,651 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:05:34,811 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:05:35,054 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 79.60826 seconds. 2021-08-20 01:05:35,066 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:05:35,068 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:05:35,134 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:05:35,140 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07212 seconds. 2021-08-20 01:05:35,142 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07689 seconds. 2021-08-20 01:05:35,490 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:06:09,745 C: 50% D:989.5GB M:234.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 14.7GB, since last ping: 2.3MB/s. CPU memory usage: 614.3MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.1kB/s Size: 3.0MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4000 WinOpenFiles: 0) (System-Wide CPU: User: 59% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 5 DAIprocs: 54) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_2] 2021-08-20 01:06:32,359 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:06:32,364 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:06:32,366 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:06:33,262 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 58.45046 seconds. 2021-08-20 01:06:33,274 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:06:33,278 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:06:33,363 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 86 iterations: 86 2021-08-20 01:06:33,368 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09127 seconds. 2021-08-20 01:06:33,371 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09681 seconds. 2021-08-20 01:06:33,618 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 2 9 and Completed 7 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:06:33,680 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:06:33,682 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:06:33,685 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:06:33,751 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:06:34,573 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 59.07556 seconds. 2021-08-20 01:06:34,584 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:06:34,587 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:06:34,649 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 92 iterations: 92 2021-08-20 01:06:34,655 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07330 seconds. 2021-08-20 01:06:34,658 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07930 seconds. 2021-08-20 01:06:35,021 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:07:10,099 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:07:10,105 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:07:10,107 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:07:10,909 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 35.88800 seconds. 2021-08-20 01:07:10,921 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:07:10,923 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:07:10,990 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:07:10,996 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07218 seconds. 2021-08-20 01:07:10,998 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07746 seconds. 2021-08-20 01:07:11,246 C: 29% D:987.2GB M:236.5GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:07:11,401 C: 29% D:987.2GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:07:14,200 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:07:14,208 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:07:14,210 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:07:15,067 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 19.3GB, since last ping: 10.6MB/s. CPU memory usage: 780.6MB, max: 894.3MB CPU: 179% Procs: 5 . GPU memory usage: 149.9MB, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 40.7kB/s Size: 3.1MB) (Connections: 58 Fds: 274 WinHandles: 0 Threads: 13 Maps: 3995 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 10% Wait: 7% DAIActiveprocs: 5 DAIprocs: 55) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_5] 2021-08-20 01:07:15,174 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 41.42318 seconds. 2021-08-20 01:07:15,185 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:07:15,187 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:07:15,255 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:07:15,265 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07342 seconds. 2021-08-20 01:07:15,268 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07867 seconds. 2021-08-20 01:07:15,621 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:07:57,192 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:07:57,200 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:07:57,202 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:07:58,032 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 42.41045 seconds. 2021-08-20 01:07:58,044 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:07:58,046 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:07:58,112 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:07:58,118 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07113 seconds. 2021-08-20 01:07:58,120 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07667 seconds. 2021-08-20 01:08:19,119 C: 34% D:985.1GB M:236.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 20.8GB, since last ping: 1.6MB/s. CPU memory usage: 566.5MB, max: 894.3MB CPU: 59% Procs: 4 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.6kB/s Size: 3.1MB) (Connections: 46 Fds: 210 WinHandles: 0 Threads: 10 Maps: 3189 WinOpenFiles: 0) (System-Wide CPU: User: 22% Nice: 0% System: 8% Wait: 1% DAIActiveprocs: 5 DAIprocs: 52) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train 1 (1) (True) [1000000, 1000000, 1000000, 1000000, 1000000, 1000000] [0.0, 0.0, 0.0, 0.0, 0.0, 0.0]] 2021-08-20 01:08:44,436 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:08:44,443 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:08:44,444 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:08:45,404 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 94.00369 seconds. 2021-08-20 01:08:45,416 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:08:45,418 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:08:45,485 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:08:45,491 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07196 seconds. 2021-08-20 01:08:45,493 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07689 seconds. 2021-08-20 01:08:45,666 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:08:49,742 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 105, fit model time: 105 2021-08-20 01:08:49,750 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 10, total model time: 106.32, fit model time: 106.31 2021-08-20 01:08:49,752 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.8311, fit model time: 1.8303 2021-08-20 01:08:49,754 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.6775, fit model time: 1.6768 2021-08-20 01:08:49,757 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 80.02, fit model time: 80.019 2021-08-20 01:08:49,759 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 79.873, fit model time: 79.873 2021-08-20 01:08:49,761 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 86, model transformed features: 10, total model time: 58.805, fit model time: 58.804 2021-08-20 01:08:49,763 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 92, model transformed features: 10, total model time: 59.376, fit model time: 59.375 2021-08-20 01:08:49,765 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 100, model transformed features: 10, total model time: 36.178, fit model time: 36.177 2021-08-20 01:08:49,768 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 41.705, fit model time: 41.704 2021-08-20 01:08:49,770 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 100, model transformed features: 10, total model time: 42.707, fit model time: 42.706 2021-08-20 01:08:49,772 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 104, model transformed features: 10, total model time: 94.3, fit model time: 94.299 2021-08-20 01:08:50,160 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.8655 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:08:50,759 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.8728 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:08:51,506 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Munge time: 1.6722 s, Train time: 378.7408 s, Score time: 4.2395 s 2021-08-20 01:08:51,580 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:08:51,594 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:08:51,836 C: 32% D:985.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:08:51,981 C: 32% D:985.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:22,692 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:22,698 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:09:22,700 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:09:23,152 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 31.17111 seconds. 2021-08-20 01:09:23,164 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:23,167 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:23,232 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:09:23,239 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07118 seconds. 2021-08-20 01:09:23,241 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.07677 seconds. 2021-08-20 01:09:23,489 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 2 3 and Completed 1 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:09:23,617 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:23,695 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:23,700 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:09:23,702 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:09:24,198 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 32.36196 seconds. 2021-08-20 01:09:24,211 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:09:24,213 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:09:24,279 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:09:24,285 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.07105 seconds. 2021-08-20 01:09:24,287 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.07651 seconds. 2021-08-20 01:09:24,641 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:09:25,246 C: 28% D:983.1GB M:237.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 27.6GB, since last ping: 9.3MB/s. CPU memory usage: 624.9MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 31 (Disk: Read: 0B/s Write: 2.3kB/s Size: 3.0MB) (Connections: 58 Fds: 267 WinHandles: 0 Threads: 13 Maps: 3994 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 12% Wait: 1% DAIActiveprocs: 5 DAIprocs: 48) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_0_fold_4] 2021-08-20 01:09:28,300 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:28,309 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:09:28,311 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:09:28,892 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 5.27049 seconds. 2021-08-20 01:09:28,907 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:28,909 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:28,983 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:09:28,991 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.08099 seconds. 2021-08-20 01:09:28,994 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08766 seconds. 2021-08-20 01:09:29,383 C: 33% D:983.0GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:43,264 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:43,270 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:09:43,271 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:09:43,738 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 19.09610 seconds. 2021-08-20 01:09:43,748 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:09:43,751 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:09:43,826 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:09:43,835 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.08282 seconds. 2021-08-20 01:09:43,838 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.08878 seconds. 2021-08-20 01:09:44,266 C: 18% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 5 6 and Completed 4 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:09:44,402 C: 18% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:49,692 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:49,698 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:09:49,700 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:09:50,187 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 20.80432 seconds. 2021-08-20 01:09:50,199 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:50,202 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:50,274 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:09:50,281 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07834 seconds. 2021-08-20 01:09:50,283 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08393 seconds. 2021-08-20 01:09:50,622 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:09:57,296 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:09:57,305 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:09:57,307 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:09:57,857 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 13.45468 seconds. 2021-08-20 01:09:57,868 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:57,871 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:57,940 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:09:57,947 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07518 seconds. 2021-08-20 01:09:57,949 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08105 seconds. 2021-08-20 01:09:58,198 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 1 8 and Completed 6 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:09:58,340 C: 33% D:974.9GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:02,525 C: 17% D:974.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:02,533 C: 17% D:974.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:10:02,535 C: 17% D:974.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:03,725 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 13.10252 seconds. 2021-08-20 01:10:03,736 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:10:03,739 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:10:03,808 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:10:03,814 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07515 seconds. 2021-08-20 01:10:03,816 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07997 seconds. 2021-08-20 01:10:04,217 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:12,542 C: 14% D:974.5GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:12,551 C: 14% D:974.5GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:10:12,553 C: 14% D:974.5GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:13,574 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 15.23350 seconds. 2021-08-20 01:10:13,588 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:13,592 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:13,669 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 90 iterations: 90 2021-08-20 01:10:13,675 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08308 seconds. 2021-08-20 01:10:13,677 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08902 seconds. 2021-08-20 01:10:13,923 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 3 10 and Completed 8 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:10:14,092 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:10:14,853 C: 16% D:975.3GB M:233.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:14,862 C: 16% D:975.3GB M:233.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:10:14,864 C: 16% D:975.3GB M:233.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:16,092 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 11.87453 seconds. 2021-08-20 01:10:16,101 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:16,104 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:16,168 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:10:16,175 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07141 seconds. 2021-08-20 01:10:16,178 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07614 seconds. 2021-08-20 01:10:16,576 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:20,095 C: 18% D:974.9GB M:235.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:20,102 C: 18% D:974.9GB M:235.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:10:20,104 C: 18% D:974.9GB M:235.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:21,405 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 7.31319 seconds. 2021-08-20 01:10:21,417 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:10:21,419 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:10:21,486 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:10:21,493 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07294 seconds. 2021-08-20 01:10:21,495 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07821 seconds. 2021-08-20 01:10:21,880 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:27,351 C: 26% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:27,356 C: 26% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:10:27,358 C: 26% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:28,383 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 11.80848 seconds. 2021-08-20 01:10:28,395 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:28,398 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:28,477 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:10:28,484 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08562 seconds. 2021-08-20 01:10:28,487 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09148 seconds. 2021-08-20 01:10:32,390 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:10:32,395 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:10:32,397 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:32,875 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 36.2GB, since last ping: 10.2MB/s. CPU memory usage: 609.2MB, max: 894.3MB CPU: 399% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 46.6kB/s Size: 3.1MB) (Connections: 46 Fds: 215 WinHandles: 0 Threads: 10 Maps: 3196 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 8% Wait: 6% DAIActiveprocs: 3 DAIprocs: 45) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_5] 2021-08-20 01:10:33,297 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 11.41764 seconds. 2021-08-20 01:10:33,309 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:33,311 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:33,379 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:10:33,385 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07379 seconds. 2021-08-20 01:10:33,388 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07904 seconds. 2021-08-20 01:10:33,662 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:10:38,244 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 31.447, fit model time: 31.446 2021-08-20 01:10:38,250 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 32.658, fit model time: 32.657 2021-08-20 01:10:38,252 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 14, total model time: 5.5744, fit model time: 5.5733 2021-08-20 01:10:38,254 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 19.579, fit model time: 19.42 2021-08-20 01:10:38,256 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 21.111, fit model time: 21.11 2021-08-20 01:10:38,258 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 13.742, fit model time: 13.741 2021-08-20 01:10:38,260 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 105, model transformed features: 15, total model time: 13.406, fit model time: 13.405 2021-08-20 01:10:38,262 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 90, model transformed features: 15, total model time: 15.548, fit model time: 15.547 2021-08-20 01:10:38,263 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 124, model transformed features: 15, total model time: 12.186, fit model time: 12.18 2021-08-20 01:10:38,265 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 7.6344, fit model time: 7.6334 2021-08-20 01:10:38,272 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 108, model transformed features: 15, total model time: 12.134, fit model time: 12.132 2021-08-20 01:10:38,274 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 97, model transformed features: 15, total model time: 11.708, fit model time: 11.707 2021-08-20 01:10:38,653 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:10:38,701 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6921 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:10:39,361 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Munge time: 0.0349 s, Train time: 102.0641 s, Score time: 4.7527 s 2021-08-20 01:10:39,512 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:10:39,979 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:10:40,023 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.98 % 2021-08-20 01:10:40,057 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Scored 27/598 models on 99 features. Last Scored [LIGHTGBM] 2021-08-20 01:10:40,064 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:10:40,067 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638488 +/- 0.04910973 [Tournament: 1.638488 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:10:40,069 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:10:40,070 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.692052 +/- 0.04037833 [Tournament: 1.692052 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:10:40,073 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638488 RMSE 2021-08-20 01:10:40,079 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:10:40,085 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:10:40,087 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:10:40,089 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:10:40,091 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:10:40,094 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:10:40,096 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:10:40,098 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:10:40,100 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:10:40,103 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:10:40,105 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:10:40,108 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:10:40,111 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Tuned 36/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:10:40,114 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:10:40,117 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:10:40,119 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 6 2021-08-20 01:10:40,122 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:10:40,457 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:10:41,254 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:10:41,272 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:10:41,276 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:10:41,554 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:10:41,627 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:10:42,360 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:42,362 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:10:42,365 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:43,450 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.89594 seconds. 2021-08-20 01:10:43,463 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:10:43,466 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:10:43,502 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:43,505 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:10:43,507 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:43,585 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:10:43,595 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.12696 seconds. 2021-08-20 01:10:43,601 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.13528 seconds. 2021-08-20 01:10:44,077 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:10:44,605 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.97544 seconds. 2021-08-20 01:10:44,618 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:10:44,621 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:10:44,684 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 01:10:44,690 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06971 seconds. 2021-08-20 01:10:44,693 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07491 seconds. 2021-08-20 01:10:45,066 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:10:49,399 C: 23% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:49,407 C: 23% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:10:49,408 C: 23% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:50,570 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 6.48860 seconds. 2021-08-20 01:10:50,585 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:10:50,587 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:10:50,674 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 01:10:50,676 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07757 seconds. 2021-08-20 01:10:50,678 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08325 seconds. 2021-08-20 01:10:51,128 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:10:54,575 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:54,581 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:10:54,583 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:55,498 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 10.43178 seconds. 2021-08-20 01:10:55,509 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:10:55,511 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:10:55,587 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:10:55,595 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08223 seconds. 2021-08-20 01:10:55,598 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08877 seconds. 2021-08-20 01:10:55,908 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 5 6 and Completed 4 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:10:56,053 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:11:00,764 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:00,771 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:11:00,774 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:01,468 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:11:01,474 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:11:01,479 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:01,805 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 10.67199 seconds. 2021-08-20 01:11:01,835 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:11:01,843 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:11:01,962 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 01:11:01,996 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.14944 seconds. 2021-08-20 01:11:02,002 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.17180 seconds. 2021-08-20 01:11:02,657 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 6.60406 seconds. 2021-08-20 01:11:02,669 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:11:02,673 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:11:02,750 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:11:02,759 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08406 seconds. 2021-08-20 01:11:02,763 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09275 seconds. 2021-08-20 01:11:02,930 C: 79% D:975.1GB M:231.5GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:11:05,589 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 2.287, fit model time: 2.2861 2021-08-20 01:11:05,597 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 3.2728, fit model time: 3.2719 2021-08-20 01:11:05,599 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 6.8034, fit model time: 6.8024 2021-08-20 01:11:05,601 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 10.781, fit model time: 10.78 2021-08-20 01:11:05,603 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 11.105, fit model time: 11.104 2021-08-20 01:11:05,605 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 6.9094, fit model time: 6.9085 2021-08-20 01:11:05,975 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.8349 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:11:06,736 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | Munge time: 0.8339 s, Train time: 21.6534 s, Score time: 2.8129 s 2021-08-20 01:11:06,802 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:11:06,813 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:11:07,090 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:11:07,190 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:11,081 C: 65% D:977.0GB M:232.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:11,088 C: 65% D:977.0GB M:232.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:11:11,089 C: 65% D:977.0GB M:232.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:11:12,672 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 5.58264 seconds. 2021-08-20 01:11:12,685 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:11:12,687 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:11:12,763 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:11:12,772 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.08326 seconds. 2021-08-20 01:11:12,774 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.08986 seconds. 2021-08-20 01:11:13,225 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:16,109 C: 66% D:976.7GB M:229.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:16,117 C: 66% D:976.7GB M:229.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:11:16,119 C: 66% D:976.7GB M:229.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:11:17,554 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 10.36283 seconds. 2021-08-20 01:11:17,576 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:17,579 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:17,656 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 128 iterations: 128 2021-08-20 01:11:17,664 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.08381 seconds. 2021-08-20 01:11:17,670 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.09196 seconds. 2021-08-20 01:11:17,958 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 3 4 and Completed 2 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:11:18,159 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:11:21,615 C: 66% D:976.4GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:21,626 C: 66% D:976.4GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:11:21,631 C: 66% D:976.4GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:11:23,752 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 10.52704 seconds. 2021-08-20 01:11:23,767 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:23,771 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:23,855 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 129 iterations: 129 2021-08-20 01:11:23,862 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.09110 seconds. 2021-08-20 01:11:23,865 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.09821 seconds. 2021-08-20 01:11:24,044 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:24,047 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:11:24,051 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:11:24,465 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:24,906 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:24,915 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:11:24,917 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:11:25,619 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 7.45928 seconds. 2021-08-20 01:11:25,636 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:11:25,639 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:11:25,754 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:11:25,785 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.14438 seconds. 2021-08-20 01:11:25,788 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.15143 seconds. 2021-08-20 01:11:26,068 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.60242 seconds. 2021-08-20 01:11:26,086 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:26,090 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:26,188 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 96 iterations: 96 2021-08-20 01:11:26,239 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.14487 seconds. 2021-08-20 01:11:26,245 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.15774 seconds. 2021-08-20 01:11:26,340 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:27,200 C: 74% D:977.5GB M:234.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:11:27,209 C: 74% D:977.5GB M:234.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:11:27,212 C: 74% D:977.5GB M:234.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:11:28,381 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 2.03980 seconds. 2021-08-20 01:11:28,398 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:28,402 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:28,497 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:11:28,522 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.11991 seconds. 2021-08-20 01:11:28,526 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.12751 seconds. 2021-08-20 01:11:28,741 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:11:32,694 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 139, model transformed features: 14, total model time: 5.9484, fit model time: 5.947 2021-08-20 01:11:32,700 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 128, model transformed features: 14, total model time: 10.685, fit model time: 10.684 2021-08-20 01:11:32,702 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 129, model transformed features: 14, total model time: 10.857, fit model time: 10.856 2021-08-20 01:11:32,703 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 124, model transformed features: 14, total model time: 7.8993, fit model time: 7.8981 2021-08-20 01:11:32,705 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 96, model transformed features: 14, total model time: 2.0476, fit model time: 2.0467 2021-08-20 01:11:32,707 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 108, model transformed features: 14, total model time: 2.4551, fit model time: 2.4541 2021-08-20 01:11:33,186 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6832 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:11:34,062 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Munge time: 0.0349 s, Train time: 22.7540 s, Score time: 3.3203 s 2021-08-20 01:11:34,214 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:11:34,588 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:11:34,621 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Experiment Progress: 4.13 % 2021-08-20 01:11:34,645 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Scored 28/598 models on 113 features. Last Scored [LIGHTGBM] 2021-08-20 01:11:34,652 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:11:34,655 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:34,657 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.683212 +/- 0.06572724 [Tournament: 1.683212 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:11:35,261 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:11:35,264 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:11:35,273 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:11:35,276 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:11:35,280 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:11:35,286 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:11:35,290 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:11:35,294 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:11:35,296 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:11:35,298 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:11:35,301 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:11:35,304 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:11:35,309 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:11:35,314 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Tuned 42/42 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [] 2021-08-20 01:11:35,522 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:11:35,689 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:11:35,748 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Model and feature tuning leaderboard (scorer=RMSE): 2021-08-20 01:11:35,751 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+-----------------------------------------------------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:11:35,754 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:11:35,756 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | |-------------+--------------+-----------------------------------------------------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------| 2021-08-20 01:11:35,758 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 0 | PASSED | TARGET_TUNING | LightGBMModel | 1.63852 | 0.0491097 | 11.5146 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.63852 | 1.63852 | 0.0491097 | 1.63852 | 0.0928991 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 1 | 1 | 1565.33 | 0 | * | + | 2021-08-20 01:11:35,760 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.64367 | 0.0614287 | 123.947 | 300 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0.001 | 0.3 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.64367 | 1.64367 | 0.0614287 | 1.64367 | 1 | 1 | 13 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.996864 | 0.996864 | 88 | 0.104973 | | | 2021-08-20 01:11:35,762 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 3 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | 1.66976 | 0.0417155 | 12.762 | 117 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 50 | True | | | [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.66976 | 1.66976 | 0.0417155 | 1.66976 | 0.102963 | 0.39 | 10 | 100 | 13 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.981289 | 0.981289 | 1233.29 | 0.636189 | | | 2021-08-20 01:11:35,763 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 8 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:8,num_as_cat:False | LightGBMModel | 1.68321 | 0.0657272 | 39.885 | 121 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | FeatureModelTuning | 1.68321 | 1.68321 | 0.0657272 | 1.68321 | 0.32179 | 0.403333 | 11 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.973446 | 0.973446 | 1403 | 0.910115 | | | 2021-08-20 01:11:35,765 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 4 | PASSED | RANDOM | LightGBMModel | 1.69092 | 0.0541736 | 6.89313 | 140 | 16 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0 | 0.7 | 0.4 | 10 | 1 | 1 | 10 | 1 | 0.001 | 0 | 200000 | | True | mse | mae | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.69092 | 1.69092 | 0.0541736 | 1.69092 | 0.0556135 | 0.466667 | 13 | 100 | 16 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.96901 | 0.96901 | 41.0667 | 1.06702 | | | 2021-08-20 01:11:35,767 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 7 | PASSED | RANDOM | LightGBMModel | 1.69205 | 0.0403783 | 72.6053 | 109 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 1 | 0.9 | 0.6 | 10 | 0 | 0.0001 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.69205 | 1.69205 | 0.0403783 | 1.69205 | 0.585776 | 0.363333 | 13 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.968361 | 0.968361 | 1263.86 | 1.09011 | | | 2021-08-20 01:11:35,769 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 2 | PASSED | DefaultIndiv: do_te:True,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | 2.08023 | 0.0352351 | 10.8259 | 93 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 50 | True | | | [1, 1, -1, 1, 0, 1, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 2.08023 | 2.08023 | 0.0352351 | 2.08023 | 0.0873429 | 0.31 | 10 | 100 | 13 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.787662 | 0.787662 | 980.306 | 8.99438 | | | 2021-08-20 01:11:35,771 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+-----------------------------------------------------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:11:35,849 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Best parameters: 2021-08-20 01:11:35,852 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_classes: 1 2021-08-20 01:11:35,855 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_class: 1 2021-08-20 01:11:35,858 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | booster: lightgbm 2021-08-20 01:11:35,860 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | seed: 1037348886 2021-08-20 01:11:35,862 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | disable_gpus: False 2021-08-20 01:11:35,863 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | n_gpus: 1 2021-08-20 01:11:35,865 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | score_f_name: RMSE 2021-08-20 01:11:35,867 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | label_counts: None 2021-08-20 01:11:35,869 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | _build_info: {'commit': '4d0fa39', 'version': '1.10.0'} 2021-08-20 01:11:35,871 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | model_class_name: LightGBMModel 2021-08-20 01:11:35,873 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_id: 0 2021-08-20 01:11:35,875 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | n_jobs: 4 2021-08-20 01:11:35,877 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | random_state: 1037348886 2021-08-20 01:11:35,879 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | pred_gap: None 2021-08-20 01:11:35,881 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | pred_periods: None 2021-08-20 01:11:35,882 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ufapt: None 2021-08-20 01:11:35,884 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | boosting_type: gbdt 2021-08-20 01:11:35,886 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | enable_early_stopping_rounds: True 2021-08-20 01:11:35,888 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | learning_rate: 0.049999999999999996 2021-08-20 01:11:35,890 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | grow_policy: depthwise 2021-08-20 01:11:35,892 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_depth: 10 2021-08-20 01:11:35,894 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_leaves: 1024 2021-08-20 01:11:35,896 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_bin: 64 2021-08-20 01:11:35,897 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | scale_pos_weight: 1.0 2021-08-20 01:11:35,899 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_delta_step: 0.0 2021-08-20 01:11:35,901 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gamma: 0.0 2021-08-20 01:11:35,903 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | colsample_bytree: 0.7999999999999999 2021-08-20 01:11:35,905 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | subsample: 0.7000000000000001 2021-08-20 01:11:35,906 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | subsample_freq: 1 2021-08-20 01:11:35,908 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | reg_lambda: 0.0 2021-08-20 01:11:35,910 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | reg_alpha: 0.0 2021-08-20 01:11:35,912 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_child_samples: 1 2021-08-20 01:11:35,913 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_data_in_bin: 1 2021-08-20 01:11:35,915 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_child_weight: 0.001 2021-08-20 01:11:35,917 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_split_gain: 0.0 2021-08-20 01:11:35,919 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | subsample_for_bin: 200000 2021-08-20 01:11:35,921 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | class_weight: None 2021-08-20 01:11:35,922 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotonicity_constraints: True 2021-08-20 01:11:35,924 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | objective: mse 2021-08-20 01:11:35,926 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | eval_metric: rmse 2021-08-20 01:11:35,928 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | early_stopping_rounds: 30 2021-08-20 01:11:35,930 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | n_estimators: 300 2021-08-20 01:11:35,932 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | importance_type: gain 2021-08-20 01:11:35,933 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_leaves: 1024 2021-08-20 01:11:35,935 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | feature_fraction_seed: 1037348887 2021-08-20 01:11:35,937 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | bagging_seed: 1037348888 2021-08-20 01:11:35,939 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_threads: 4 2021-08-20 01:11:35,941 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | device_type: cpu 2021-08-20 01:11:35,943 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_device_id: 0 2021-08-20 01:11:35,949 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_platform_id: 0 2021-08-20 01:11:35,951 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_use_dp: False 2021-08-20 01:11:35,953 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | verbose: -1 2021-08-20 01:11:35,956 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | lossguide: False 2021-08-20 01:11:35,958 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | silent: True 2021-08-20 01:11:35,960 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | accuracy: 7 2021-08-20 01:11:35,962 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | time_tolerance: 2 2021-08-20 01:11:35,964 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | interpretability: 8 2021-08-20 01:11:35,966 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ensemble_level: 1 2021-08-20 01:11:35,968 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | train_shape: (1000, 11) 2021-08-20 01:11:35,970 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | valid_shape: None 2021-08-20 01:11:35,973 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | model_origin: TARGET_TUNING 2021-08-20 01:11:35,975 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | resumed_experiment_id: 2021-08-20 01:11:35,977 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | str_uuid: ret_b97a3cbb-f99d-414f-aa44-cddc62776504 2021-08-20 01:11:35,980 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | experiment_description: buvobamu 2021-08-20 01:11:35,982 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | train_dataset_name: Friedman1-results.csv 2021-08-20 01:11:35,985 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | valid_data_name: [Valid] 2021-08-20 01:11:35,987 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | test_data_name: None 2021-08-20 01:11:35,989 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | outer_trial: (1, 2) 2021-08-20 01:11:35,992 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ngenes: 11 2021-08-20 01:11:35,994 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ngenes_max: 100 2021-08-20 01:11:35,996 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | uses_gpu: True 2021-08-20 01:11:35,998 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | early_stopping_threshold: None 2021-08-20 01:11:36,001 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | early_stopping_limit: None 2021-08-20 01:11:36,003 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotone_constraints: [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] 2021-08-20 01:11:36,005 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotone_penalty: 0.0 2021-08-20 01:11:36,009 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | categorical_feature: 2021-08-20 01:11:36,011 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotone_constraints_method: intermediate 2021-08-20 01:11:36,013 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best job_order: 0 2021-08-20 01:11:36,015 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best_iterations: 135 2021-08-20 01:11:36,017 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best_ngenes: 11 2021-08-20 01:11:36,019 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best_nfeatures: 17 2021-08-20 01:11:36,021 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Selected population via model tournament mode: [('LightGBMModel', 1.6385166645050049), ('LightGBMModel', 1.6385166645050049), ('LightGBMModel', 1.6385166645050049), ('LightGBMModel', 1.6436718702316284), ('LightGBMModel', 1.669759750366211), ('LightGBMModel', 2.080228328704834), ('LightGBMModel', 1.6920517683029175), ('LightGBMModel', 1.6909176111221313), ('LightGBMModel', 1.683212161064148)] 2021-08-20 01:11:36,031 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Model and feature tuning scores (RMSE, less is better): 2021-08-20 01:11:36,033 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,036 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,038 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,040 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:11:36,042 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:11:36,044 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.683212 +/- 0.06572724 [Tournament: 1.683212 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:11:36,046 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.690918 +/- 0.05417363 [Tournament: 1.690918 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:11:36,048 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 7 : 1.692052 +/- 0.04037833 [Tournament: 1.692052 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,050 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 8 : 2.080228 +/- 0.03523514 [Tournament: 2.080228 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:11:36,052 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to tuning population 2021-08-20 01:11:37,886 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Parameter tuning: end : Duration: 634.5521 s 2021-08-20 01:11:38,399 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Prepare Feature Evolution 2021-08-20 01:11:38,407 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Feature evolution has 0 brain cached individuals out of 8 individuals 2021-08-20 01:11:38,411 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Making 1 new individuals during preparation for evolution 2021-08-20 01:11:38,604 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 45.1GB, since last ping: 48.7MB/s. CPU memory usage: 481.6MB, max: 894.3MB CPU: 79% Procs: 3 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/3145728 (OpenFilesUser: 0) PSThreads: 12 (Disk: Read: 0B/s Write: 170.6kB/s Size: 3.1MB) (Connections: 34 Fds: 131 WinHandles: 0 Threads: 7 Maps: 2373 WinOpenFiles: 0) (System-Wide CPU: User: 64% Nice: 0% System: 10% Wait: 2% DAIActiveprocs: 22 DAIprocs: 61) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Prepare_Feature_Evolutionfeature_selection_(FS)] 2021-08-20 01:11:38,922 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:11:38,928 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Model params_base (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:11:38,930 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Model params (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:11:39,249 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Pre-pruning 1 gene(s) from 12 active base genes 2021-08-20 01:11:39,262 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Starting search for statistically relevant features (FS scheme) 2021-08-20 01:11:39,270 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | FS Permute population of size 1 has 2 unique transformations that include: ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:11:39,278 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Transforming FS train 2021-08-20 01:11:39,286 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Using 2 parallel workers (1 parent workers) for fit_transform. 2021-08-20 01:11:39,706 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Submitted 2 and Completed 2 non-identity feature engineering tasks out of 12 total tasks (including 10 identity) 2021-08-20 01:11:39,714 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Transforming FS valid 2021-08-20 01:11:40,136 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 INFO | Submitted 2 and Completed 2 non-identity feature engineering tasks out of 12 total tasks (including 10 identity) 2021-08-20 01:11:40,597 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 INFO | 10 features created during FS Permute 2021-08-20 01:11:41,029 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:11:41,031 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 DATA | Model params_base (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:11:41,034 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 DATA | Model params (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:11:41,716 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:11:41,722 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Model params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:11:41,724 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Model params: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:11:41,725 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 INFO | FS: fold_id=0/2 2021-08-20 01:11:41,906 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) start. 2021-08-20 01:11:42,595 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:42,598 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41031', 'X_1': '0.33523', 'X_3': '0.56239', 'X_4': '0.34860'} 2021-08-20 01:11:42,600 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:43,626 C: 74% D:976.0GB M:232.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) end. Took 1.71978 seconds. 2021-08-20 01:11:48,103 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) start. 2021-08-20 01:11:48,109 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) start. 2021-08-20 01:11:48,260 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:11:48,266 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) end. Took 0.16064 seconds. 2021-08-20 01:11:48,268 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) end. Took 0.16987 seconds. 2021-08-20 01:11:48,388 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:11:49,912 C: 42% D:975.5GB M:231.4GB NODE:LOCAL1 7646 INFO | FS: fold_id=1/2 2021-08-20 01:11:50,101 C: 42% D:975.5GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) start. 2021-08-20 01:11:55,012 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:55,017 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41275', 'X_1': '0.37985', 'X_3': '0.58310', 'X_4': '0.32120'} 2021-08-20 01:11:55,019 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:55,844 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) end. Took 5.74852 seconds. 2021-08-20 01:11:56,211 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) start. 2021-08-20 01:11:56,219 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) start. 2021-08-20 01:11:56,411 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:11:56,418 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) end. Took 0.20352 seconds. 2021-08-20 01:11:56,422 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) end. Took 0.21382 seconds. 2021-08-20 01:11:56,548 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:11:58,568 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 INFO | FS: fold_id=2/2 2021-08-20 01:11:58,774 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) start. 2021-08-20 01:11:59,150 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:59,153 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43118', 'X_1': '0.36603', 'X_3': '0.55504', 'X_4': '0.31388'} 2021-08-20 01:11:59,157 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:00,129 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) end. Took 1.35754 seconds. 2021-08-20 01:12:00,423 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) start. 2021-08-20 01:12:00,427 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) start. 2021-08-20 01:12:00,667 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:00,676 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) end. Took 0.24810 seconds. 2021-08-20 01:12:00,680 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) end. Took 0.26162 seconds. 2021-08-20 01:12:00,839 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:03,032 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:12:03,038 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params_base (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:12:03,039 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:12:03,041 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:12:03,043 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:12:03,045 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:12:03,048 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | FS: fold_id=0/2 2021-08-20 01:12:03,221 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) start. 2021-08-20 01:12:03,521 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:03,523 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43238', 'X_1': '0.33524', 'X_3': '0.58360', 'X_4': '0.27867'} 2021-08-20 01:12:03,526 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:04,514 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) end. Took 1.29405 seconds. 2021-08-20 01:12:04,734 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) start. 2021-08-20 01:12:04,738 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) start. 2021-08-20 01:12:04,920 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:04,927 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) end. Took 0.18832 seconds. 2021-08-20 01:12:04,929 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) end. Took 0.19766 seconds. 2021-08-20 01:12:05,062 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:06,976 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 INFO | FS: fold_id=1/2 2021-08-20 01:12:07,178 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) start. 2021-08-20 01:12:07,456 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:07,459 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43100', 'X_1': '0.47994', 'X_3': '0.53554', 'X_4': '0.35813'} 2021-08-20 01:12:07,463 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:08,390 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) end. Took 1.21635 seconds. 2021-08-20 01:12:08,653 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) start. 2021-08-20 01:12:08,656 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) start. 2021-08-20 01:12:08,869 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:08,874 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) end. Took 0.21723 seconds. 2021-08-20 01:12:08,876 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) end. Took 0.22513 seconds. 2021-08-20 01:12:08,986 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:11,008 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 INFO | FS: fold_id=2/2 2021-08-20 01:12:11,166 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) start. 2021-08-20 01:12:11,475 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:11,477 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.46649', 'X_1': '0.35158', 'X_3': '0.60755', 'X_4': '0.32738'} 2021-08-20 01:12:11,479 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:12,200 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) end. Took 1.03747 seconds. 2021-08-20 01:12:12,406 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) start. 2021-08-20 01:12:12,410 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) start. 2021-08-20 01:12:12,556 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:12,561 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) end. Took 0.15135 seconds. 2021-08-20 01:12:12,563 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) end. Took 0.16012 seconds. 2021-08-20 01:12:12,682 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:14,407 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Pruning 5 features(s) out of 10 features(s) 2021-08-20 01:12:14,413 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Removed features: ['37_X_9', '5_X_5', '6_X_6', '7_X_7', '8_X_8'] 2021-08-20 01:12:14,415 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Selected features: ['0_X_0', '1_X_1', '2_X_2', '3_X_3', '4_X_4'] 2021-08-20 01:12:14,604 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | FS strategy run finished in 36.18509 s 2021-08-20 01:12:14,965 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Feature Evolution starting with population of 8 scored individuals (scores=['1.638517', '1.638517', '1.638517', '1.643672', '1.66976', '1.683212', '1.690918']) 2021-08-20 01:12:14,967 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | +-------------+----------------------------------------+-----------------------------------------------------------------+--------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+----------------------+----------------------------------------------+--------------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+--------------------+-----------+--------+ 2021-08-20 01:12:14,969 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | best_learning_rate | task | experiment_id | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:12:14,971 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | |-------------+----------------------------------------+-----------------------------------------------------------------+--------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+----------------------+----------------------------------------------+--------------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+--------------------+-----------+--------| 2021-08-20 01:12:14,974 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 1 | PASSED | TARGET_TUNING | LightGBMModel | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | | + | 2021-08-20 01:12:14,976 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 0 | PASSED | TARGET_TUNING | LightGBMModel | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | * | + | 2021-08-20 01:12:14,978 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 1 | PASSED | TARGET_TUNING | LightGBMModel | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | | + | 2021-08-20 01:12:14,981 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.6436718702316284 | 0.06142866984009743 | 123.9472188949585 | 300 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0.001 | 0.3 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6436718702316284 | 1.6436718702316284 | 0.06142866984009743 | 1.6436718702316284 | 1.0 | 1 | 13 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9968636040927696 | 0.9968636040927696 | 88 | 0.1049731946050262 | | | 2021-08-20 01:12:14,983 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 3 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | 1.669759750366211 | 0.04171554744243622 | 12.761950731277466 | 117 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 100 | True | | | [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.669759750366211 | 1.669759750366211 | 0.04171554744243622 | 1.669759750366211 | 0.10296278403868692 | 0.39 | 10 | 100 | 13 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.981288873531444 | 0.981288873531444 | 1233.29 | 0.6361892630651612 | | | 2021-08-20 01:12:14,985 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 8 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:8,num_as_cat:False | LightGBMModel | 1.683212161064148 | 0.06572724133729935 | 39.88503384590149 | 121 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | | | | BeginEvolve | 1.683212161064148 | 1.683212161064148 | 0.06572724133729935 | 1.683212161064148 | 0.3217904701815282 | 0.403333 | 11 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9734463084375017 | 0.9734463084375017 | 1403 | 0.9101148057080886 | | | 2021-08-20 01:12:14,987 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 4 | PASSED | RANDOM | LightGBMModel | 1.6909176111221313 | 0.054173633456230164 | 6.89313268661499 | 140 | 16 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0 | 0.7 | 0.4 | 10 | 1 | 1 | 10 | 1 | 0.001 | 0 | 200000 | | True | mse | mae | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6909176111221313 | 1.6909176111221313 | 0.054173633456230164 | 1.6909176111221313 | 0.05561345182304341 | 0.466667 | 13 | 100 | 16 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9690103490125975 | 0.9690103490125975 | 41.0667 | 1.067017507821158 | | | 2021-08-20 01:12:14,989 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | -2 | UNSCORED (ADDED AT START OF EVOLUTION) | EXTRA_FS | LightGBMModel | | | | 0 | 0 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 135 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 12 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 0.049999999999999996 | | 59939c96-0150-11ec-a7e1-0242c0a8fe02 | BeginEvolve | | | | | | 0 | 11 | 100 | 0 | TargetTransformer_identity_noclip | False | False | 0 | 0 | | | 0 | | | | 2021-08-20 01:12:14,991 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | +-------------+----------------------------------------+-----------------------------------------------------------------+--------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+----------------------+----------------------------------------------+--------------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+--------------------+-----------+--------+ 2021-08-20 01:12:15,067 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Feature Evolution population of size 6 has 2 unique transformations that include: ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:12:15,079 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Feature Evolution... 2021-08-20 01:12:15,090 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:12:15,094 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:12:15,097 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 7 2021-08-20 01:12:15,099 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:12:15,112 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/6 base individual models out of 6 total models across folds, out of population with 6 individuals). 2021-08-20 01:12:17,107 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 72 munging tasks out of 72 total tasks (including identity) for 6 indivs and 6 folds 2021-08-20 01:12:17,118 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1116316524', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 10) 2021-08-20 01:12:17,120 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:12:17,122 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='2835907363', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 27) 2021-08-20 01:12:17,125 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:12:17,359 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:12:17,543 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:12:17,643 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:17,646 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:12:17,648 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:17,823 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:17,825 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:12:17,827 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:18,524 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 1.16499 seconds. 2021-08-20 01:12:18,535 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:12:18,537 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:12:18,590 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.04739 seconds. 2021-08-20 01:12:18,607 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:12:18,610 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:12:18,662 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:12:18,668 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.13048 seconds. 2021-08-20 01:12:18,670 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.13540 seconds. 2021-08-20 01:12:18,674 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 112 iterations: 112 2021-08-20 01:12:18,681 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.06965 seconds. 2021-08-20 01:12:18,683 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07741 seconds. 2021-08-20 01:12:19,146 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:12:19,194 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:12:48,320 C: 48% D:969.9GB M:231.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 50.4GB, since last ping: 26.5MB/s. CPU memory usage: 626.8MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.4kB/s Size: 8.8MB) (Connections: 60 Fds: 274 WinHandles: 0 Threads: 13 Maps: 3998 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 13% Wait: 3% DAIActiveprocs: 1 DAIprocs: 45) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_7)_score_train-training_xgb_indiv_5_fold_4] 2021-08-20 01:13:45,974 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:13:45,984 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:13:45,987 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:13:45,989 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:13:46,027 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:13:46,029 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:13:46,795 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 87.58910 seconds. 2021-08-20 01:13:46,810 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:13:46,812 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 87.66654 seconds. 2021-08-20 01:13:46,814 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:13:46,824 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:13:46,826 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:13:46,890 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 132 iterations: 132 2021-08-20 01:13:46,892 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 134 iterations: 134 2021-08-20 01:13:46,895 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.08239 seconds. 2021-08-20 01:13:46,897 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07054 seconds. 2021-08-20 01:13:46,899 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.08792 seconds. 2021-08-20 01:13:46,901 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07533 seconds. 2021-08-20 01:13:47,246 C: 44% D:970.2GB M:239.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 4 5 and Completed 9 training tasks out of 6 total tasks for 6 indivs and 6 folds 2021-08-20 01:13:47,389 C: 44% D:970.2GB M:239.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:13:47,493 C: 44% D:970.2GB M:239.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:13:52,747 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:13:52,754 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:13:52,756 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:13:53,220 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 55.6GB, since last ping: 5.5MB/s. CPU memory usage: 622.9MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 78.2kB/s Size: 8.8MB) (Connections: 60 Fds: 268 WinHandles: 0 Threads: 13 Maps: 3993 WinOpenFiles: 0) (System-Wide CPU: User: 33% Nice: 0% System: 12% Wait: 3% DAIActiveprocs: 2 DAIprocs: 43) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_7)_score_train 1 (1) (True) [119.8] [0.0]] 2021-08-20 01:13:53,526 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 6.13661 seconds. 2021-08-20 01:13:53,538 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:13:53,540 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:13:53,618 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 93 iterations: 93 2021-08-20 01:13:53,623 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.08244 seconds. 2021-08-20 01:13:53,626 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08802 seconds. 2021-08-20 01:14:50,822 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:14:50,829 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:14:50,830 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:14:51,527 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 64.03353 seconds. 2021-08-20 01:14:51,539 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:14:51,542 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:14:51,609 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:14:51,614 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07241 seconds. 2021-08-20 01:14:51,616 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07770 seconds. 2021-08-20 01:14:51,807 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | Completed 11 training tasks out of 6 total tasks for 6 indivs and 6 folds 2021-08-20 01:14:53,387 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 97, model transformed features: 5, total model time: 1.5071, fit model time: 1.5062 2021-08-20 01:14:53,392 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 112, model transformed features: 5, total model time: 1.3428, fit model time: 1.342 2021-08-20 01:14:53,394 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 134, model transformed features: 5, total model time: 87.946, fit model time: 87.945 2021-08-20 01:14:53,396 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 132, model transformed features: 5, total model time: 87.903, fit model time: 87.902 2021-08-20 01:14:53,397 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 93, model transformed features: 5, total model time: 6.4386, fit model time: 6.4376 2021-08-20 01:14:53,399 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 106, model transformed features: 5, total model time: 64.296, fit model time: 64.295 2021-08-20 01:14:53,790 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,836 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,873 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,940 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6832 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,942 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6909 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:54,012 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.7786 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:14:55,107 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Munge time: 2.0291 s, Train time: 154.6828 s, Score time: 1.7351 s 2021-08-20 01:14:55,628 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:14:55,925 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:14:55,935 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:14:55,938 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Time so far: 1566 secs 2021-08-20 01:14:55,941 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Stopping in: 84833 secs 2021-08-20 01:14:55,985 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Experiment Progress: 9.89 % 2021-08-20 01:14:56,084 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Scored 67/598 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:14:56,096 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:14:56,099 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:14:56,101 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:14:56,103 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:14:56,105 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.683212 +/- 0.06572724 [Tournament: 1.683212 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:14:56,108 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.690918 +/- 0.05417363 [Tournament: 1.690918 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:14:56,116 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.778612 +/- 0.07008359 [Tournament: 1.778612 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:14:56,119 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:14:56,121 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:14:56,123 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:14:56,126 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:14:56,128 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:14:56,131 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:14:56,135 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:14:56,137 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:14:56,140 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:14:56,143 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:14:56,145 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:14:56,148 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:14:56,151 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:14:56,154 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:14:56,157 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:14:56,159 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Starting Iteration: 8 2021-08-20 01:14:56,161 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:14:56,895 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 63.4GB, since last ping: 37.0MB/s. CPU memory usage: 519.9MB, max: 894.3MB CPU: 199% Procs: 8 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/8388608 (OpenFilesUser: 0) PSThreads: 12 (Disk: Read: 0B/s Write: 213.0kB/s Size: 8.5MB) (Connections: 34 Fds: 167 WinHandles: 0 Threads: 7 Maps: 2404 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 6% Wait: 9% DAIActiveprocs: 3 DAIprocs: 36) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_Evolution-mutating: mutation_rate = 1:begin] 2021-08-20 01:14:58,425 C: 28% D:969.3GB M:239.4GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:15:01,653 C: 32% D:969.2GB M:238.2GB NODE:LOCAL1 7646 INFO | Completed 162 munging tasks out of 162 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:15:01,938 C: 32% D:969.2GB M:238.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:15:02,032 C: 32% D:969.2GB M:238.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:16:01,966 C: 17% D:963.1GB M:234.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 71.2GB, since last ping: 23.3MB/s. CPU memory usage: 625.3MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 8.9MB) (Connections: 58 Fds: 265 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 12% Nice: 0% System: 7% Wait: 6% DAIActiveprocs: 3 DAIprocs: 37) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_3_fold_2] 2021-08-20 01:16:25,333 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:16:25,341 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:16:25,343 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:16:26,303 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 84.27103 seconds. 2021-08-20 01:16:26,315 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:16:26,318 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:16:26,395 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 122 iterations: 122 2021-08-20 01:16:26,402 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08395 seconds. 2021-08-20 01:16:26,404 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.08947 seconds. 2021-08-20 01:16:26,652 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 2 3 and Completed 5 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:16:26,661 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:16:26,664 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Time: 84.8828 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 128, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:16:26,668 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:16:26,678 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | Time: 84.8828 s: LIGHTGBM 2021-08-20 01:16:26,705 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:16:26,708 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:16:26,711 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:16:26,786 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:16:27,980 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 86.04095 seconds. 2021-08-20 01:16:27,994 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:16:27,996 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:16:28,075 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:16:28,082 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.08507 seconds. 2021-08-20 01:16:28,084 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.08990 seconds. 2021-08-20 01:16:28,413 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:16:28,443 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:16:28,445 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:16:28,447 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:16:29,682 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 2.88783 seconds. 2021-08-20 01:16:29,700 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:16:29,704 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:16:29,780 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:16:29,788 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08428 seconds. 2021-08-20 01:16:29,791 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09143 seconds. 2021-08-20 01:16:30,148 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:17:12,711 C: 29% D:956.4GB M:224.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 77.6GB, since last ping: 20.2MB/s. CPU memory usage: 623.7MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 8.9MB) (Connections: 58 Fds: 287 WinHandles: 0 Threads: 13 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 10% Wait: 9% DAIActiveprocs: 4 DAIprocs: 39) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_3_fold_5] 2021-08-20 01:17:45,076 C: 17% D:959.0GB M:227.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:45,082 C: 17% D:959.0GB M:227.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:17:45,084 C: 17% D:959.0GB M:227.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:17:47,485 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 75.93039 seconds. 2021-08-20 01:17:47,500 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:17:47,503 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:17:47,584 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 115 iterations: 115 2021-08-20 01:17:47,593 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08861 seconds. 2021-08-20 01:17:47,597 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09586 seconds. 2021-08-20 01:17:47,868 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 5 6 and Completed 8 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:17:47,872 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:17:47,875 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 DATA | Time: 79.5987 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 128, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:17:47,877 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:17:47,880 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | Time: 79.5987 s: LIGHTGBM 2021-08-20 01:17:48,005 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:17:49,316 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:49,324 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:17:49,326 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:17:50,284 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 2.27929 seconds. 2021-08-20 01:17:50,295 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:17:50,298 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:17:50,374 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:17:50,382 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08280 seconds. 2021-08-20 01:17:50,385 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.08932 seconds. 2021-08-20 01:17:50,715 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:17:50,780 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:50,783 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:17:50,785 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:17:51,713 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 83.29943 seconds. 2021-08-20 01:17:51,724 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:17:51,726 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:17:51,795 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 107 iterations: 107 2021-08-20 01:17:51,801 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.07389 seconds. 2021-08-20 01:17:51,803 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.07930 seconds. 2021-08-20 01:17:52,163 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:17:52,192 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:52,194 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:17:52,196 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:17:52,633 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 1.91862 seconds. 2021-08-20 01:17:52,645 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:17:52,647 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:17:52,718 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:17:52,726 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.07862 seconds. 2021-08-20 01:17:52,729 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.08403 seconds. 2021-08-20 01:17:53,050 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:53,052 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:17:53,054 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:17:53,069 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:17:53,468 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.30469 seconds. 2021-08-20 01:17:53,479 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:17:53,481 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:17:53,551 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:17:53,558 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07601 seconds. 2021-08-20 01:17:53,560 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08148 seconds. 2021-08-20 01:17:53,901 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:17:53,953 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:53,955 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:17:53,957 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:17:54,389 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.31977 seconds. 2021-08-20 01:17:54,399 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:17:54,401 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:17:54,467 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:17:54,473 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07133 seconds. 2021-08-20 01:17:54,475 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.07630 seconds. 2021-08-20 01:17:54,827 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:17:56,880 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:56,886 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:17:56,888 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:17:57,343 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 3.44198 seconds. 2021-08-20 01:17:57,354 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:17:57,357 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:17:57,419 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:17:57,426 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.06964 seconds. 2021-08-20 01:17:57,429 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.07460 seconds. 2021-08-20 01:17:57,789 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:18:02,719 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:18:02,728 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:18:02,730 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:18:03,319 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 8.49104 seconds. 2021-08-20 01:18:03,331 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:18:03,334 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:18:03,401 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:18:03,408 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07360 seconds. 2021-08-20 01:18:03,410 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.07939 seconds. 2021-08-20 01:18:03,625 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 0 13 and Completed 15 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:18:03,779 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:18:03,808 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:18:03,810 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:18:03,812 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:18:04,206 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 6.41676 seconds. 2021-08-20 01:18:04,219 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:18:04,222 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:18:04,301 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:18:04,308 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.08551 seconds. 2021-08-20 01:18:04,311 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.09178 seconds. 2021-08-20 01:18:04,692 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:18:16,981 C: 30% D:958.6GB M:230.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 86.2GB, since last ping: 29.6MB/s. CPU memory usage: 622.4MB, max: 894.3MB CPU: 59% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 38.3kB/s Size: 9.0MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 20% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 4 DAIprocs: 39) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_5_fold_2] 2021-08-20 01:19:20,024 C: 16% D:959.1GB M:235.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:20,033 C: 16% D:959.1GB M:235.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:19:20,035 C: 16% D:959.1GB M:235.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:21,709 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 90.4GB, since last ping: 18.5MB/s. CPU memory usage: 623.8MB, max: 894.3MB CPU: 30% Procs: 5 . GPU memory usage: 149.9MB, max: 299.9MB GPUs usage: 1% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.0MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 14% Nice: 0% System: 7% Wait: 4% DAIActiveprocs: 3 DAIprocs: 34) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_5_fold_2] 2021-08-20 01:19:21,716 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 77.02218 seconds. 2021-08-20 01:19:21,727 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:21,730 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:21,802 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 207 iterations: 207 2021-08-20 01:19:21,814 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08207 seconds. 2021-08-20 01:19:21,818 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08908 seconds. 2021-08-20 01:19:22,069 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 2 15 and Completed 17 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:22,072 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:19:22,075 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Time: 78.4504 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:19:22,078 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:19:22,080 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Time: 78.4504 s: LIGHTGBM 2021-08-20 01:19:22,209 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:19:22,548 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:22,550 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:19:22,552 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:24,621 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 80.30962 seconds. 2021-08-20 01:19:24,634 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:19:24,636 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:19:24,719 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:19:24,729 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.09144 seconds. 2021-08-20 01:19:24,732 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.09738 seconds. 2021-08-20 01:19:25,212 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:25,214 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:19:25,217 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:25,229 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:19:26,214 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 4.00513 seconds. 2021-08-20 01:19:26,224 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:26,227 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:26,298 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 122 iterations: 122 2021-08-20 01:19:26,306 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07828 seconds. 2021-08-20 01:19:26,309 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08387 seconds. 2021-08-20 01:19:26,943 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:19:26,955 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:26,957 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:19:26,959 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:27,997 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 2.76761 seconds. 2021-08-20 01:19:28,017 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:19:28,021 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:19:28,095 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:19:28,107 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.08237 seconds. 2021-08-20 01:19:28,111 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.09408 seconds. 2021-08-20 01:19:28,389 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:28,396 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:19:28,399 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:28,504 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:19:29,434 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 2.49087 seconds. 2021-08-20 01:19:29,444 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:29,446 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:29,524 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 126 iterations: 126 2021-08-20 01:19:29,529 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08206 seconds. 2021-08-20 01:19:29,531 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08704 seconds. 2021-08-20 01:19:29,914 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) start. 2021-08-20 01:19:29,941 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:19:29,943 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:19:29,945 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:30,174 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:30,178 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.36014', 'X_3': '0.56708'} 2021-08-20 01:19:30,181 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:30,527 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) end. Took 0.61346 seconds. 2021-08-20 01:19:30,539 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) start. 2021-08-20 01:19:30,542 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) start. 2021-08-20 01:19:30,622 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:30,630 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) end. Took 0.08574 seconds. 2021-08-20 01:19:30,634 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) end. Took 0.09296 seconds. 2021-08-20 01:19:30,779 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 2.27489 seconds. 2021-08-20 01:19:30,796 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:30,800 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:30,875 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:19:30,881 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08197 seconds. 2021-08-20 01:19:30,884 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08890 seconds. 2021-08-20 01:19:30,986 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:31,223 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:31,260 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:31,262 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37831', 'X_3': '0.58737'} 2021-08-20 01:19:31,264 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:31,487 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:31,490 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.33556', 'X_3': '0.60792'} 2021-08-20 01:19:31,493 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:31,623 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.63696 seconds. 2021-08-20 01:19:31,634 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:31,637 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:31,705 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:31,710 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07292 seconds. 2021-08-20 01:19:31,713 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.07821 seconds. 2021-08-20 01:19:31,864 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.64098 seconds. 2021-08-20 01:19:31,874 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:31,876 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:31,943 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 120 iterations: 120 2021-08-20 01:19:31,948 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07171 seconds. 2021-08-20 01:19:31,951 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.07639 seconds. 2021-08-20 01:19:32,156 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) start. 2021-08-20 01:19:32,207 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 7 fold_id= 4 23 and Completed 25 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:32,334 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:32,525 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:32,527 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37401', 'X_3': '0.60371'} 2021-08-20 01:19:32,529 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:32,622 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:32,624 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.35415', 'X_3': '0.57112'} 2021-08-20 01:19:32,632 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:32,910 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) end. Took 0.75344 seconds. 2021-08-20 01:19:32,922 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) start. 2021-08-20 01:19:32,924 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) start. 2021-08-20 01:19:32,995 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:19:32,999 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.66495 seconds. 2021-08-20 01:19:33,001 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) end. Took 0.07595 seconds. 2021-08-20 01:19:33,003 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) end. Took 0.08156 seconds. 2021-08-20 01:19:33,010 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:33,013 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:33,084 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:33,092 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07700 seconds. 2021-08-20 01:19:33,095 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.08376 seconds. 2021-08-20 01:19:33,364 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:33,842 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:33,848 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.34500', 'X_3': '0.58786'} 2021-08-20 01:19:33,849 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:34,209 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.84402 seconds. 2021-08-20 01:19:34,219 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:34,222 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:34,296 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:34,302 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07974 seconds. 2021-08-20 01:19:34,305 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.08520 seconds. 2021-08-20 01:19:34,710 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:36,763 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 122, model transformed features: 8, total model time: 84.573, fit model time: 84.572 2021-08-20 01:19:36,772 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 124, model transformed features: 8, total model time: 86.359, fit model time: 86.358 2021-08-20 01:19:36,774 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 139, model transformed features: 8, total model time: 3.2003, fit model time: 3.1993 2021-08-20 01:19:36,776 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 115, model transformed features: 8, total model time: 77.668, fit model time: 77.667 2021-08-20 01:19:36,778 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 8, total model time: 2.575, fit model time: 2.5741 2021-08-20 01:19:36,780 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 107, model transformed features: 8, total model time: 83.579, fit model time: 83.579 2021-08-20 01:19:36,782 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 2.2085, fit model time: 2.2076 2021-08-20 01:19:36,784 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 1.5938, fit model time: 1.593 2021-08-20 01:19:36,786 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 14, total model time: 1.5938, fit model time: 1.5928 2021-08-20 01:19:36,788 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 3.7249, fit model time: 3.7239 2021-08-20 01:19:36,790 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 8.7884, fit model time: 8.7873 2021-08-20 01:19:36,792 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 6.735, fit model time: 6.7341 2021-08-20 01:19:36,794 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 207, model transformed features: 13, total model time: 77.328, fit model time: 77.327 2021-08-20 01:19:36,796 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 150, model transformed features: 13, total model time: 81.178, fit model time: 81.177 2021-08-20 01:19:36,798 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 122, model transformed features: 13, total model time: 4.3006, fit model time: 4.2996 2021-08-20 01:19:36,800 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 124, model transformed features: 13, total model time: 3.1277, fit model time: 3.1264 2021-08-20 01:19:36,802 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 126, model transformed features: 13, total model time: 2.7912, fit model time: 2.7902 2021-08-20 01:19:36,804 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 105, model transformed features: 13, total model time: 2.5795, fit model time: 2.5786 2021-08-20 01:19:36,806 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 0.93734, fit model time: 0.93647 2021-08-20 01:19:36,808 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 0.93104, fit model time: 0.92977 2021-08-20 01:19:36,810 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 120, model transformed features: 2, total model time: 0.9137, fit model time: 0.91285 2021-08-20 01:19:36,812 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 106, model transformed features: 2, total model time: 1.088, fit model time: 1.087 2021-08-20 01:19:36,814 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 0.95901, fit model time: 0.95799 2021-08-20 01:19:36,816 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 1.1626, fit model time: 1.1614 2021-08-20 01:19:37,248 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.7786 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:19:37,295 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,343 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,373 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,426 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6439 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,447 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6224 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:38,310 C: 36% D:957.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:38,329 C: 36% D:957.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=3.4508 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:19:39,066 C: 36% D:957.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Munge time: 3.2637 s, Train time: 273.0469 s, Score time: 2.3053 s 2021-08-20 01:19:39,404 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Updated total models to train from 598 -> 310 for number of individuals 8 -> 8 2021-08-20 01:19:39,526 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:19:39,961 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:19:39,978 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:19:39,981 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Time so far: 1850 secs 2021-08-20 01:19:39,984 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Stopping in: 84549 secs 2021-08-20 01:19:40,031 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Experiment Progress: 25.4 % 2021-08-20 01:19:40,104 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Scored 91/310 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:19:40,113 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:19:40,116 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:19:40,118 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.622405 +/- 0.05499941 [Tournament: 1.622405 Model: LIGHTGBM Feature Cost: 15] 2021-08-20 01:19:40,120 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:19:40,122 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:19:40,124 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.643852 +/- 0.06142867 [Tournament: 1.643852 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:19:40,126 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:19:40,127 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.778612 +/- 0.07008359 [Tournament: 1.778612 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:19:40,130 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 7 : 3.450785 +/- 0.06098503 [Tournament: 3.450785 Model: LIGHTGBM Feature Cost: 2] 2021-08-20 01:19:40,132 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 5 transformers creating 8 total features and 8 features for model: 1.619091 RMSE 2021-08-20 01:19:40,134 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | Top 8 variable importances of best individual: 2021-08-20 01:19:40,137 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:19:40,139 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:19:40,142 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.788475 2021-08-20 01:19:40,144 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 2 2_X_2 0.296163 2021-08-20 01:19:40,147 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.295632 2021-08-20 01:19:40,150 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.276633 2021-08-20 01:19:40,152 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 5 10_InteractionSub:X_0:X_1 0.086895 2021-08-20 01:19:40,155 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 6 5_X_5 0.077826 2021-08-20 01:19:40,157 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.031322 2021-08-20 01:19:40,161 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:19:40,163 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:19:40,166 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Starting Iteration: 9 2021-08-20 01:19:40,168 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:19:42,895 C: 29% D:958.0GB M:236.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:19:44,357 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 INFO | Completed 168 munging tasks out of 168 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:19:44,373 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='3875894129', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 13) 2021-08-20 01:19:44,377 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:19:44,664 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:19:44,764 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:44,936 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:44,938 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:19:44,941 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:45,198 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:45,200 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:19:45,203 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:46,215 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.45108 seconds. 2021-08-20 01:19:46,226 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:46,228 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:46,293 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 120 iterations: 120 2021-08-20 01:19:46,300 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07116 seconds. 2021-08-20 01:19:46,302 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07641 seconds. 2021-08-20 01:19:46,542 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.87390 seconds. 2021-08-20 01:19:46,555 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:19:46,558 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:19:46,627 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 157 iterations: 157 2021-08-20 01:19:46,634 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07620 seconds. 2021-08-20 01:19:46,637 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08159 seconds. 2021-08-20 01:19:46,648 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:46,904 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:46,907 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:19:46,909 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:46,978 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:19:47,252 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:47,259 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:19:47,260 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:47,932 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.28356 seconds. 2021-08-20 01:19:47,943 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:47,946 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:48,019 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:19:48,026 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07889 seconds. 2021-08-20 01:19:48,029 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08511 seconds. 2021-08-20 01:19:48,395 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:48,656 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:48,659 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:19:48,661 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:48,696 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.71721 seconds. 2021-08-20 01:19:48,712 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:19:48,715 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:19:48,787 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:19:48,795 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07914 seconds. 2021-08-20 01:19:48,797 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08552 seconds. 2021-08-20 01:19:49,152 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:49,436 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:19:49,442 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:19:49,444 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:49,661 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.26553 seconds. 2021-08-20 01:19:49,673 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:49,676 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:49,756 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 115 iterations: 115 2021-08-20 01:19:49,764 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08737 seconds. 2021-08-20 01:19:49,766 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09329 seconds. 2021-08-20 01:19:50,125 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:19:50,339 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.18788 seconds. 2021-08-20 01:19:50,350 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:50,352 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:50,417 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:19:50,423 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07062 seconds. 2021-08-20 01:19:50,426 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07614 seconds. 2021-08-20 01:19:50,780 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:50,888 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:50,891 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:19:50,894 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:19:51,175 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:51,177 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:19:51,180 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:19:51,538 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 1.41334 seconds. 2021-08-20 01:19:51,549 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:19:51,551 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:19:51,624 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 147 iterations: 147 2021-08-20 01:19:51,631 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.07887 seconds. 2021-08-20 01:19:51,633 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.08395 seconds. 2021-08-20 01:19:51,844 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.06272 seconds. 2021-08-20 01:19:51,861 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:51,864 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:51,931 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:19:51,937 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.07315 seconds. 2021-08-20 01:19:51,939 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.07934 seconds. 2021-08-20 01:19:51,969 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:52,462 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:19:52,872 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:52,877 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:19:52,879 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:19:52,959 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:52,962 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:19:52,964 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:19:53,487 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.52063 seconds. 2021-08-20 01:19:53,504 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:53,507 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:53,590 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:19:53,599 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.09029 seconds. 2021-08-20 01:19:53,602 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.09864 seconds. 2021-08-20 01:19:53,626 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 1.16424 seconds. 2021-08-20 01:19:53,641 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:19:53,644 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:19:53,707 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 158 iterations: 158 2021-08-20 01:19:53,713 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.06893 seconds. 2021-08-20 01:19:53,715 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.07402 seconds. 2021-08-20 01:19:54,332 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:54,445 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:54,775 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:54,777 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:19:54,780 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:19:54,863 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:19:54,865 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:19:54,867 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:19:55,487 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.15501 seconds. 2021-08-20 01:19:55,499 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:55,502 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:55,514 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.06956 seconds. 2021-08-20 01:19:55,526 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:55,528 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:55,577 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:19:55,584 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.08171 seconds. 2021-08-20 01:19:55,587 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.08765 seconds. 2021-08-20 01:19:55,598 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 133 iterations: 133 2021-08-20 01:19:55,606 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.07592 seconds. 2021-08-20 01:19:55,610 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.08269 seconds. 2021-08-20 01:19:55,916 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 0 13 and Completed 16 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:56,056 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) start. 2021-08-20 01:19:56,183 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:01,758 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:01,764 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024'} 2021-08-20 01:20:01,766 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:01,972 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:01,975 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019'} 2021-08-20 01:20:01,978 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:02,335 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) end. Took 6.27929 seconds. 2021-08-20 01:20:02,346 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) start. 2021-08-20 01:20:02,348 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) start. 2021-08-20 01:20:02,391 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 6.20720 seconds. 2021-08-20 01:20:02,402 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:02,404 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:02,417 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:02,424 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) end. Took 0.07411 seconds. 2021-08-20 01:20:02,427 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) end. Took 0.08073 seconds. 2021-08-20 01:20:02,473 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:02,478 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07297 seconds. 2021-08-20 01:20:02,480 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.07838 seconds. 2021-08-20 01:20:03,043 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:03,183 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) start. 2021-08-20 01:20:03,369 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:03,371 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105'} 2021-08-20 01:20:03,373 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:03,432 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:03,435 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946'} 2021-08-20 01:20:03,437 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:03,845 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.80173 seconds. 2021-08-20 01:20:03,854 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:03,856 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:03,894 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) end. Took 0.71019 seconds. 2021-08-20 01:20:03,906 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) start. 2021-08-20 01:20:03,908 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) start. 2021-08-20 01:20:03,926 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 43 iterations: 43 2021-08-20 01:20:03,931 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07366 seconds. 2021-08-20 01:20:03,933 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.07850 seconds. 2021-08-20 01:20:03,973 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:03,978 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) end. Took 0.06890 seconds. 2021-08-20 01:20:03,980 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) end. Took 0.07456 seconds. 2021-08-20 01:20:04,685 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:04,802 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:04,986 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:04,988 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996'} 2021-08-20 01:20:04,991 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:05,075 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:05,076 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150'} 2021-08-20 01:20:05,081 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:05,504 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.81858 seconds. 2021-08-20 01:20:05,516 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:05,518 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:05,577 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.77443 seconds. 2021-08-20 01:20:05,586 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 36 iterations: 36 2021-08-20 01:20:05,587 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:05,590 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07205 seconds. 2021-08-20 01:20:05,593 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.07747 seconds. 2021-08-20 01:20:05,641 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:05,712 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:05,718 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.12677 seconds. 2021-08-20 01:20:05,721 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.13288 seconds. 2021-08-20 01:20:05,998 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:20:06,095 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 7 fold_id= 1 20 and Completed 22 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:06,231 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:06,264 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:06,266 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:06,268 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:06,638 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:06,640 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:06,642 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:07,060 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.06205 seconds. 2021-08-20 01:20:07,072 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:20:07,074 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:20:07,142 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:20:07,149 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07406 seconds. 2021-08-20 01:20:07,151 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07959 seconds. 2021-08-20 01:20:07,465 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.23308 seconds. 2021-08-20 01:20:07,480 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:07,483 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:07,552 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:20:07,559 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07623 seconds. 2021-08-20 01:20:07,562 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08258 seconds. 2021-08-20 01:20:07,631 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:07,966 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:20:08,307 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:08,315 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:08,316 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:08,558 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:08,563 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:08,567 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:09,972 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.34017 seconds. 2021-08-20 01:20:09,989 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:09,994 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:10,100 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:20:10,108 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.11383 seconds. 2021-08-20 01:20:10,112 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.12294 seconds. 2021-08-20 01:20:10,500 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 2.53458 seconds. 2021-08-20 01:20:10,513 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:20:10,516 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:20:10,586 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:10,602 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:20:10,610 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09321 seconds. 2021-08-20 01:20:10,614 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09987 seconds. 2021-08-20 01:20:10,906 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:10,909 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:10,912 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:11,070 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:11,429 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:11,433 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:20:11,438 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:12,762 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.17511 seconds. 2021-08-20 01:20:12,778 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:12,782 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:12,906 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:20:12,913 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.13101 seconds. 2021-08-20 01:20:12,916 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.13893 seconds. 2021-08-20 01:20:12,998 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.92790 seconds. 2021-08-20 01:20:13,021 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:13,024 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:13,124 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 116 iterations: 116 2021-08-20 01:20:13,131 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.10870 seconds. 2021-08-20 01:20:13,134 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.11709 seconds. 2021-08-20 01:20:13,350 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:16,288 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 120, model transformed features: 15, total model time: 1.721, fit model time: 1.7201 2021-08-20 01:20:16,294 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 157, model transformed features: 15, total model time: 2.1816, fit model time: 2.1805 2021-08-20 01:20:16,296 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 106, model transformed features: 15, total model time: 1.5781, fit model time: 1.5772 2021-08-20 01:20:16,299 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 150, model transformed features: 15, total model time: 2.0308, fit model time: 2.0294 2021-08-20 01:20:16,301 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 115, model transformed features: 15, total model time: 1.5847, fit model time: 1.5836 2021-08-20 01:20:16,303 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 100, model transformed features: 15, total model time: 1.4743, fit model time: 1.4735 2021-08-20 01:20:16,304 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 147, model transformed features: 11, total model time: 1.7024, fit model time: 1.7016 2021-08-20 01:20:16,306 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 139, model transformed features: 11, total model time: 1.3481, fit model time: 1.3471 2021-08-20 01:20:16,308 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 105, model transformed features: 11, total model time: 1.8411, fit model time: 1.8401 2021-08-20 01:20:16,310 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 158, model transformed features: 11, total model time: 1.4434, fit model time: 1.4425 2021-08-20 01:20:16,312 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 150, model transformed features: 11, total model time: 1.4846, fit model time: 1.4837 2021-08-20 01:20:16,314 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 133, model transformed features: 11, total model time: 1.3442, fit model time: 1.3432 2021-08-20 01:20:16,316 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 6.5703, fit model time: 6.5695 2021-08-20 01:20:16,318 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 6.48, fit model time: 6.4791 2021-08-20 01:20:16,319 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 43, model transformed features: 4, total model time: 1.0739, fit model time: 1.073 2021-08-20 01:20:16,321 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 0.98109, fit model time: 0.98016 2021-08-20 01:20:16,323 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 36, model transformed features: 4, total model time: 1.1448, fit model time: 1.1439 2021-08-20 01:20:16,325 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 1.0986, fit model time: 1.0977 2021-08-20 01:20:16,327 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 97, model transformed features: 10, total model time: 1.3677, fit model time: 1.3669 2021-08-20 01:20:16,329 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 105, model transformed features: 10, total model time: 1.5294, fit model time: 1.5286 2021-08-20 01:20:16,332 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 2.6918, fit model time: 2.6906 2021-08-20 01:20:16,334 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 10, total model time: 2.8835, fit model time: 2.8826 2021-08-20 01:20:16,336 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 10, total model time: 2.601, fit model time: 2.5999 2021-08-20 01:20:16,338 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 116, model transformed features: 10, total model time: 2.3034, fit model time: 2.3024 2021-08-20 01:20:16,901 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6844 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,004 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6544 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,021 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,130 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,185 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:18,391 C: 81% D:956.9GB M:227.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=4.0426 LIGHTGBM ['InteractionsTransformer'] 2021-08-20 01:20:18,482 C: 81% D:956.9GB M:227.7GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:18,505 C: 81% D:956.9GB M:227.7GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.6595 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:19,887 C: 76% D:956.8GB M:227.6GB NODE:LOCAL1 7646 INFO | Munge time: 1.5110 s, Train time: 28.9688 s, Score time: 3.2849 s 2021-08-20 01:20:20,567 C: 76% D:956.8GB M:227.6GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:20:21,150 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:20:21,178 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:20:21,181 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Time so far: 1891 secs 2021-08-20 01:20:21,184 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Stopping in: 84508 secs 2021-08-20 01:20:21,254 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Experiment Progress: 32.1 % 2021-08-20 01:20:21,347 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Scored 115/310 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:20:21,360 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:20:21,363 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:20:21,365 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:20:21,367 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:20:21,369 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.654428 +/- 0.05772004 [Tournament: 1.654428 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:20:21,371 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.659539 +/- 0.05454549 [Tournament: 1.659539 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:20:21,373 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:20:21,374 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.68438 +/- 0.04906118 [Tournament: 1.68438 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:20:21,376 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 7 : 4.042583 +/- 0.09375197 [Tournament: 4.042583 Model: LIGHTGBM Feature Cost: 4] 2021-08-20 01:20:21,378 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 5 transformers creating 8 total features and 8 features for model: 1.619091 RMSE 2021-08-20 01:20:21,383 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | Top 8 variable importances of best individual: 2021-08-20 01:20:21,390 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:20:21,394 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:20:21,397 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.788475 2021-08-20 01:20:21,400 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 2 2_X_2 0.296163 2021-08-20 01:20:21,403 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.295632 2021-08-20 01:20:21,406 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.276633 2021-08-20 01:20:21,409 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 5 10_InteractionSub:X_0:X_1 0.086895 2021-08-20 01:20:21,413 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 6 5_X_5 0.077826 2021-08-20 01:20:21,416 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.031322 2021-08-20 01:20:21,421 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:20:21,424 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:20:21,427 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Starting Iteration: 10 2021-08-20 01:20:21,430 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:20:24,723 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:20:24,751 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | Completed 180 munging tasks out of 180 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:20:25,105 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:20:25,263 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:25,652 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:25,656 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:25,669 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:25,696 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:25,699 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:25,704 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:28,003 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 2.88456 seconds. 2021-08-20 01:20:28,022 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:20:28,028 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:20:28,145 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 132 iterations: 132 2021-08-20 01:20:28,154 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.12721 seconds. 2021-08-20 01:20:28,158 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 92.4GB, since last ping: 14.3MB/s. CPU memory usage: 635.5MB, max: 895.1MB CPU: 397% Procs: 6 . GPU memory usage: 299.9MB, max: 299.9MB GPUs usage: 0% OpenFiles: 0/6291456 (OpenFilesUser: 0) PSThreads: 20 (Disk: Read: 0B/s Write: 532.0kB/s Size: 9.0MB) (Connections: 58 Fds: 275 WinHandles: 0 Threads: 20 Maps: 4000 WinOpenFiles: 0) (System-Wide CPU: User: 67% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 23 DAIprocs: 59) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_10)_score_train-training_xgb_indiv_0_fold_2] 2021-08-20 01:20:28,208 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.13637 seconds. 2021-08-20 01:20:28,412 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 3.14115 seconds. 2021-08-20 01:20:28,433 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:28,437 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:28,533 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 166 iterations: 166 2021-08-20 01:20:28,596 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.15708 seconds. 2021-08-20 01:20:28,601 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.16819 seconds. 2021-08-20 01:20:28,741 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:29,125 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:20:29,246 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:29,248 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:29,253 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:29,462 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:29,465 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:29,470 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:30,912 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 2.17016 seconds. 2021-08-20 01:20:30,932 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:30,939 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:31,083 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:20:31,115 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.17666 seconds. 2021-08-20 01:20:31,118 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.18683 seconds. 2021-08-20 01:20:31,340 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 2.21054 seconds. 2021-08-20 01:20:31,364 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:20:31,374 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:20:31,456 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:20:31,465 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.09632 seconds. 2021-08-20 01:20:31,469 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.10476 seconds. 2021-08-20 01:20:31,634 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:31,891 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:31,980 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:31,987 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:31,989 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:32,227 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:20:32,232 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:20:32,236 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:33,617 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.72849 seconds. 2021-08-20 01:20:33,630 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:33,647 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:33,740 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:20:33,804 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.15655 seconds. 2021-08-20 01:20:33,806 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.17536 seconds. 2021-08-20 01:20:34,147 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 2.50924 seconds. 2021-08-20 01:20:34,162 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:34,166 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:34,271 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 144 iterations: 144 2021-08-20 01:20:34,278 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.11048 seconds. 2021-08-20 01:20:34,283 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.11937 seconds. 2021-08-20 01:20:34,520 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:20:34,867 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:34,884 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:34,888 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:34,892 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:35,223 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:35,228 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:35,232 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:37,014 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 2.49163 seconds. 2021-08-20 01:20:37,031 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:20:37,034 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:20:37,154 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:20:37,204 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.16289 seconds. 2021-08-20 01:20:37,208 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.17535 seconds. 2021-08-20 01:20:37,486 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 2.61380 seconds. 2021-08-20 01:20:37,507 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:37,518 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:37,605 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 158 iterations: 158 2021-08-20 01:20:37,616 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.10453 seconds. 2021-08-20 01:20:37,620 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.11283 seconds. 2021-08-20 01:20:37,650 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 2 9 and Completed 11 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:37,845 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:38,164 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:20:38,271 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:38,275 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:38,278 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:38,579 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:38,602 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:38,606 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:41,762 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 3.59833 seconds. 2021-08-20 01:20:41,785 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:20:41,790 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:20:41,909 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 181 iterations: 181 2021-08-20 01:20:41,967 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.17569 seconds. 2021-08-20 01:20:41,972 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.18671 seconds. 2021-08-20 01:20:42,480 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:42,941 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 5.09294 seconds. 2021-08-20 01:20:42,956 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:42,959 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:43,036 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 263 iterations: 263 2021-08-20 01:20:43,047 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.08696 seconds. 2021-08-20 01:20:43,050 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.09378 seconds. 2021-08-20 01:20:43,140 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:43,144 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:43,148 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:43,652 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:44,031 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:44,042 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:20:44,045 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:44,597 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 2.11556 seconds. 2021-08-20 01:20:44,622 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:44,628 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:44,718 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 133 iterations: 133 2021-08-20 01:20:44,728 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.10041 seconds. 2021-08-20 01:20:44,731 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.11499 seconds. 2021-08-20 01:20:45,210 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:20:45,774 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:45,777 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:45,779 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:45,928 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 2.27453 seconds. 2021-08-20 01:20:45,944 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:45,949 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:46,031 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 183 iterations: 183 2021-08-20 01:20:46,039 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.09144 seconds. 2021-08-20 01:20:46,042 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.09956 seconds. 2021-08-20 01:20:46,270 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.06243 seconds. 2021-08-20 01:20:46,281 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:20:46,284 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:20:46,359 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:46,385 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.09926 seconds. 2021-08-20 01:20:46,388 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.10589 seconds. 2021-08-20 01:20:46,472 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:46,800 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:46,942 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:46,947 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:46,950 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:47,087 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:47,090 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:47,093 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:47,504 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.03411 seconds. 2021-08-20 01:20:47,516 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:47,518 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:47,570 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 0.76932 seconds. 2021-08-20 01:20:47,582 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:47,584 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:47,588 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:47,598 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07835 seconds. 2021-08-20 01:20:47,601 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08473 seconds. 2021-08-20 01:20:47,650 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:47,659 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07374 seconds. 2021-08-20 01:20:47,663 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08036 seconds. 2021-08-20 01:20:48,113 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 6 fold_id= 3 16 and Completed 19 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:48,255 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:20:48,417 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:48,716 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:48,723 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:48,725 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:48,729 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:48,732 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:48,734 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:49,241 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 0.82341 seconds. 2021-08-20 01:20:49,254 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:49,257 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:49,267 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.01206 seconds. 2021-08-20 01:20:49,278 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:20:49,280 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:20:49,320 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 282 iterations: 282 2021-08-20 01:20:49,326 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.06930 seconds. 2021-08-20 01:20:49,328 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.07560 seconds. 2021-08-20 01:20:49,344 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:20:49,351 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.06982 seconds. 2021-08-20 01:20:49,353 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.07524 seconds. 2021-08-20 01:20:49,654 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:49,806 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:20:49,957 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:20:49,959 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:20:49,961 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:50,084 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:50,086 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708'} 2021-08-20 01:20:50,088 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:50,469 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 0.81371 seconds. 2021-08-20 01:20:50,481 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:50,484 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:50,559 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:50,567 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08205 seconds. 2021-08-20 01:20:50,569 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08786 seconds. 2021-08-20 01:20:50,678 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 0.87108 seconds. 2021-08-20 01:20:50,688 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:20:50,690 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:20:50,754 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 69 iterations: 69 2021-08-20 01:20:50,759 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.06868 seconds. 2021-08-20 01:20:50,761 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.07384 seconds. 2021-08-20 01:20:50,906 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:51,096 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:51,186 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:51,190 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737'} 2021-08-20 01:20:51,193 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:51,358 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:51,360 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792'} 2021-08-20 01:20:51,362 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:51,894 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 0.79764 seconds. 2021-08-20 01:20:51,905 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:51,907 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:51,927 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.02100 seconds. 2021-08-20 01:20:51,937 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:51,939 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:51,970 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:20:51,975 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.06774 seconds. 2021-08-20 01:20:51,977 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07248 seconds. 2021-08-20 01:20:52,005 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:20:52,010 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07066 seconds. 2021-08-20 01:20:52,012 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07535 seconds. 2021-08-20 01:20:52,346 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:20:52,443 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:52,613 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:52,616 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371'} 2021-08-20 01:20:52,618 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:52,709 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:52,711 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112'} 2021-08-20 01:20:52,713 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:53,239 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 0.89338 seconds. 2021-08-20 01:20:53,250 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:20:53,252 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:20:53,293 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 0.84917 seconds. 2021-08-20 01:20:53,303 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:53,305 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:53,318 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 83 iterations: 83 2021-08-20 01:20:53,323 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.07064 seconds. 2021-08-20 01:20:53,325 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.07519 seconds. 2021-08-20 01:20:53,376 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 69 iterations: 69 2021-08-20 01:20:53,381 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07578 seconds. 2021-08-20 01:20:53,383 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08058 seconds. 2021-08-20 01:20:53,724 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:54,274 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:54,280 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786'} 2021-08-20 01:20:54,282 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:54,884 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.16029 seconds. 2021-08-20 01:20:54,894 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:54,897 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:54,957 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 69 iterations: 69 2021-08-20 01:20:54,963 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.06598 seconds. 2021-08-20 01:20:54,966 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07122 seconds. 2021-08-20 01:20:55,151 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:57,403 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 132, model transformed features: 14, total model time: 3.407, fit model time: 3.406 2021-08-20 01:20:57,409 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 166, model transformed features: 14, total model time: 3.5887, fit model time: 3.5874 2021-08-20 01:20:57,411 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 119, model transformed features: 14, total model time: 2.7056, fit model time: 2.7043 2021-08-20 01:20:57,413 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 14, total model time: 2.628, fit model time: 2.6262 2021-08-20 01:20:57,415 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 14, total model time: 2.1829, fit model time: 2.1811 2021-08-20 01:20:57,417 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 144, model transformed features: 14, total model time: 2.9312, fit model time: 2.9299 2021-08-20 01:20:57,419 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 171, model transformed features: 11, total model time: 2.9582, fit model time: 2.957 2021-08-20 01:20:57,421 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 158, model transformed features: 11, total model time: 3.0162, fit model time: 3.0146 2021-08-20 01:20:57,422 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 181, model transformed features: 11, total model time: 4.1033, fit model time: 4.1021 2021-08-20 01:20:57,424 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 263, model transformed features: 11, total model time: 5.4773, fit model time: 5.4759 2021-08-20 01:20:57,426 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 133, model transformed features: 11, total model time: 2.5193, fit model time: 2.5183 2021-08-20 01:20:57,428 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 183, model transformed features: 11, total model time: 2.6667, fit model time: 2.6658 2021-08-20 01:20:57,429 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.4198, fit model time: 1.419 2021-08-20 01:20:57,431 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.3794, fit model time: 1.3783 2021-08-20 01:20:57,433 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.076, fit model time: 1.0748 2021-08-20 01:20:57,435 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 282, model transformed features: 13, total model time: 1.0856, fit model time: 1.0848 2021-08-20 01:20:57,436 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 13, total model time: 1.2933, fit model time: 1.2925 2021-08-20 01:20:57,438 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.0996, fit model time: 1.0986 2021-08-20 01:20:57,441 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 69, model transformed features: 5, total model time: 1.1676, fit model time: 1.1668 2021-08-20 01:20:57,443 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 84, model transformed features: 5, total model time: 1.0621, fit model time: 1.0612 2021-08-20 01:20:57,444 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 5, total model time: 1.3021, fit model time: 1.3013 2021-08-20 01:20:57,446 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 83, model transformed features: 5, total model time: 1.1963, fit model time: 1.1956 2021-08-20 01:20:57,448 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 69, model transformed features: 5, total model time: 1.1148, fit model time: 1.114 2021-08-20 01:20:57,450 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 69, model transformed features: 5, total model time: 1.4307, fit model time: 1.4298 2021-08-20 01:20:57,893 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6344 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:57,934 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:57,948 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:57,989 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,047 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,068 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6729 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,877 C: 29% D:951.7GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,911 C: 29% D:951.7GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=2.6649 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:21:00,035 C: 22% D:951.5GB M:237.6GB NODE:LOCAL1 7646 INFO | Munge time: 0.0704 s, Train time: 30.3891 s, Score time: 2.5023 s 2021-08-20 01:21:00,470 C: 22% D:951.5GB M:237.6GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:21:01,374 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:21:01,398 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:21:01,402 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Time so far: 1931 secs 2021-08-20 01:21:01,406 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Stopping in: 84468 secs 2021-08-20 01:21:01,481 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Experiment Progress: 38.9 % 2021-08-20 01:21:01,578 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Scored 139/310 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:21:01,588 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:21:01,591 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.56956 +/- 0.07548585 [Tournament: 1.56956 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:21:01,593 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:21:01,595 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.634389 +/- 0.05224874 [Tournament: 1.634389 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:21:01,597 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:21:01,599 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:21:01,601 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:21:01,602 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.672878 +/- 0.0708335 [Tournament: 1.672878 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:21:01,604 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 7 : 2.664922 +/- 0.07229169 [Tournament: 2.664922 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:21:01,606 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 10 transformers creating 13 total features and 13 features for model: 1.56956 RMSE 2021-08-20 01:21:01,608 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:21:01,613 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:21:01,616 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:21:01,619 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.555859 2021-08-20 01:21:01,621 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 2 10_InteractionAdd:X_0:X_1 0.391387 2021-08-20 01:21:01,624 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.266291 2021-08-20 01:21:01,626 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.178320 2021-08-20 01:21:01,629 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 5 1_X_1 0.064184 2021-08-20 01:21:01,631 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 6 0_X_0 0.040219 2021-08-20 01:21:01,634 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 7 10_InteractionSub:X_0:X_1 0.032582 2021-08-20 01:21:01,637 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.005531 2021-08-20 01:21:01,639 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_0:X_1 0.004636 2021-08-20 01:21:01,643 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:21:01,646 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:21:01,649 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Starting Iteration: 11 2021-08-20 01:21:01,651 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:21:04,134 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:21:04,152 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | Completed 162 munging tasks out of 162 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:21:04,410 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:21:04,491 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:21:33,060 C: 48% D:948.8GB M:233.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 95.5GB, since last ping: 20.7MB/s. CPU memory usage: 623.5MB, max: 911.3MB CPU: 20% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.8kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 60% Nice: 0% System: 7% Wait: 3% DAIActiveprocs: 1 DAIprocs: 37) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:22:38,290 C: 67% D:948.0GB M:232.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 101.7GB, since last ping: 3.6MB/s. CPU memory usage: 624.8MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 57% Nice: 0% System: 8% Wait: 0% DAIActiveprocs: 1 DAIprocs: 40) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:23:43,472 C: 66% D:945.0GB M:231.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 103.1GB, since last ping: 3.3MB/s. CPU memory usage: 624.1MB, max: 911.3MB CPU: 20% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 59% Nice: 0% System: 5% Wait: 0% DAIActiveprocs: 1 DAIprocs: 34) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:24:47,989 C: 28% D:941.9GB M:236.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 107.9GB, since last ping: 36.0MB/s. CPU memory usage: 624.2MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.0kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 48% Nice: 0% System: 6% Wait: 8% DAIActiveprocs: 1 DAIprocs: 33) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:25:14,274 C: 14% D:937.8GB M:245.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:25:14,283 C: 14% D:937.8GB M:245.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_0': '0.40875', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:25:14,285 C: 14% D:937.8GB M:245.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:25:15,357 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 250.86616 seconds. 2021-08-20 01:25:15,368 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:25:15,370 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:25:15,436 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 146 iterations: 146 2021-08-20 01:25:15,447 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07475 seconds. 2021-08-20 01:25:15,450 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08140 seconds. 2021-08-20 01:25:15,720 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 2 3 and Completed 5 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:25:15,725 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:25:15,729 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 DATA | Time: 251.466 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 5, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:25:15,733 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:25:15,737 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | Time: 251.466 s: LIGHTGBM 2021-08-20 01:25:15,867 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:25:41,823 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:25:41,832 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_0': '0.41809', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:25:41,834 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:25:42,778 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 278.36791 seconds. 2021-08-20 01:25:42,790 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:25:42,793 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:25:42,858 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:25:42,864 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07015 seconds. 2021-08-20 01:25:42,866 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.07547 seconds. 2021-08-20 01:25:43,114 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 3 4 and Completed 6 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:25:43,281 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:25:43,329 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:25:43,332 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_0': '0.39619', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:25:43,335 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:25:44,885 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 29.01743 seconds. 2021-08-20 01:25:44,897 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:25:44,899 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:25:44,972 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 175 iterations: 175 2021-08-20 01:25:44,983 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08166 seconds. 2021-08-20 01:25:44,988 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08922 seconds. 2021-08-20 01:25:45,374 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:25:56,143 C: 60% D:935.2GB M:240.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 115.3GB, since last ping: 25.5MB/s. CPU memory usage: 620.9MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 27.5kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 54% Nice: 0% System: 8% Wait: 5% DAIActiveprocs: 1 DAIprocs: 32) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_5] 2021-08-20 01:27:03,287 C: 64% D:934.5GB M:240.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 120.4GB, since last ping: 11.2MB/s. CPU memory usage: 623.0MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.4kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 59% Nice: 0% System: 5% Wait: 5% DAIActiveprocs: 1 DAIprocs: 32) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_5] 2021-08-20 01:27:22,811 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:27:22,818 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_0': '0.38650', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:27:22,820 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:27:23,711 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 100.43034 seconds. 2021-08-20 01:27:23,721 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:27:23,723 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:27:23,794 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 01:27:23,800 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07685 seconds. 2021-08-20 01:27:23,802 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08107 seconds. 2021-08-20 01:27:24,031 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 5 6 and Completed 8 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:27:24,037 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:27:24,039 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 DATA | Time: 98.824 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 5, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:27:24,040 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:27:24,043 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | Time: 98.824 s: LIGHTGBM 2021-08-20 01:27:24,162 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:27:34,755 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:27:34,764 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_0': '0.43046', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:27:34,766 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:27:35,684 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 11.52193 seconds. 2021-08-20 01:27:35,694 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:27:35,697 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:27:35,761 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 102 iterations: 102 2021-08-20 01:27:35,781 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07106 seconds. 2021-08-20 01:27:35,785 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08955 seconds. 2021-08-20 01:27:36,061 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 0 7 and Completed 9 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:27:36,111 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:27:36,113 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_0': '0.40506', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:27:36,116 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:27:36,203 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:27:37,059 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 111.68573 seconds. 2021-08-20 01:27:37,072 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:27:37,074 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:27:37,140 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 107 iterations: 107 2021-08-20 01:27:37,146 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07115 seconds. 2021-08-20 01:27:37,148 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.07637 seconds. 2021-08-20 01:27:37,494 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:28:09,688 C: 49% D:930.2GB M:239.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 125.0GB, since last ping: 28.6MB/s. CPU memory usage: 622.8MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.0kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 63% Nice: 0% System: 5% Wait: 0% DAIActiveprocs: 2 DAIprocs: 31) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_2] 2021-08-20 01:29:04,838 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:29:04,846 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:29:04,848 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:29:05,440 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 89.23655 seconds. 2021-08-20 01:29:05,452 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:29:05,455 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:29:05,527 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 62 iterations: 62 2021-08-20 01:29:05,532 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.07688 seconds. 2021-08-20 01:29:05,534 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08228 seconds. 2021-08-20 01:29:05,789 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 2 9 and Completed 11 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:29:05,793 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:29:05,796 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Time: 88.457 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:29:05,799 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:29:05,802 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | Time: 88.457 s: LIGHTGBM 2021-08-20 01:29:05,924 C: 25% D:925.3GB M:244.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:29:14,330 C: 18% D:925.2GB M:242.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 131.1GB, since last ping: 14.5MB/s. CPU memory usage: 623.4MB, max: 911.3MB CPU: 69% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 20.4kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 4% Wait: 7% DAIActiveprocs: 3 DAIprocs: 30) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:30:23,893 C: 22% D:926.1GB M:239.7GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 135.7GB, since last ping: 2.7MB/s. CPU memory usage: 623.7MB, max: 911.3MB CPU: 49% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.2kB/s Size: 9.1MB) (Connections: 58 Fds: 281 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 5% Wait: 9% DAIActiveprocs: 3 DAIprocs: 29) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:31:30,583 C: 24% D:921.7GB M:243.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 138.0GB, since last ping: 13.2MB/s. CPU memory usage: 624.7MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 5% Wait: 1% DAIActiveprocs: 2 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:32:38,688 C: 22% D:914.7GB M:238.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 144.4GB, since last ping: 13.7MB/s. CPU memory usage: 623.5MB, max: 911.3MB CPU: 69% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.3kB/s Size: 9.1MB) (Connections: 58 Fds: 282 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 6% Wait: 4% DAIActiveprocs: 3 DAIprocs: 28) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:33:45,650 C: 22% D:913.3GB M:234.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 149.4GB, since last ping: 8.5MB/s. CPU memory usage: 623.5MB, max: 911.3MB CPU: 49% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.6kB/s Size: 9.1MB) (Connections: 58 Fds: 281 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 6% Wait: 4% DAIActiveprocs: 3 DAIprocs: 30) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:34:21,077 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:34:21,085 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:34:21,086 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:34:21,795 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 404.29980 seconds. 2021-08-20 01:34:21,808 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:34:21,810 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:34:21,884 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 89 iterations: 89 2021-08-20 01:34:21,891 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07999 seconds. 2021-08-20 01:34:21,893 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08605 seconds. 2021-08-20 01:34:22,129 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 3 10 and Completed 12 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:34:22,138 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:34:22,140 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Time: 316.348 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:34:22,142 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:34:22,144 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | Time: 316.348 s: LIGHTGBM 2021-08-20 01:34:22,278 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:34:22,280 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:34:22,282 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:34:22,292 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:34:22,871 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 316.94686 seconds. 2021-08-20 01:34:22,883 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:34:22,886 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:34:22,951 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 96 iterations: 96 2021-08-20 01:34:22,957 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07088 seconds. 2021-08-20 01:34:22,959 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.07637 seconds. 2021-08-20 01:34:23,238 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:34:23,246 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:34:23,248 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:34:23,289 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:34:23,837 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.54506 seconds. 2021-08-20 01:34:23,846 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:34:23,849 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:34:23,912 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 92 iterations: 92 2021-08-20 01:34:23,917 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.06811 seconds. 2021-08-20 01:34:23,919 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.07255 seconds. 2021-08-20 01:34:24,213 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:34:50,124 C: 23% D:911.3GB M:240.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 153.7GB, since last ping: 9.2MB/s. CPU memory usage: 624.0MB, max: 911.3MB CPU: 59% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.1MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 4% Wait: 1% DAIActiveprocs: 1 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_0] 2021-08-20 01:35:56,067 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 158.0GB, since last ping: 18.1MB/s. CPU memory usage: 625.0MB, max: 911.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 21 (Disk: Read: 0B/s Write: 1.1kB/s Size: 9.1MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 3% Wait: 7% DAIActiveprocs: 0 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_0] 2021-08-20 01:35:56,119 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:35:56,122 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:35:56,125 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:35:56,833 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 93.54276 seconds. 2021-08-20 01:35:56,852 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:35:56,856 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:35:56,938 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 76 iterations: 76 2021-08-20 01:35:56,945 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.08912 seconds. 2021-08-20 01:35:56,948 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.09663 seconds. 2021-08-20 01:35:57,190 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 0 13 and Completed 15 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:35:57,197 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:35:57,199 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Time: 93.1045 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:35:57,201 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:35:57,203 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Time: 93.1045 s: LIGHTGBM 2021-08-20 01:35:57,326 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:36:06,277 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:36:06,286 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:36:06,288 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:36:06,966 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 102.75454 seconds. 2021-08-20 01:36:06,978 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:36:06,981 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:36:07,053 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:36:07,058 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07767 seconds. 2021-08-20 01:36:07,061 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08295 seconds. 2021-08-20 01:36:07,333 C: 24% D:904.7GB M:240.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 1 14 and Completed 16 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:36:07,487 C: 24% D:904.7GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:37:00,918 C: 23% D:908.5GB M:240.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 163.4GB, since last ping: 12.9MB/s. CPU memory usage: 625.8MB, max: 911.3MB CPU: 79% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 9.1MB) (Connections: 58 Fds: 274 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 4% Wait: 2% DAIActiveprocs: 2 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:38:08,035 C: 22% D:909.3GB M:243.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 166.8GB, since last ping: 1.5MB/s. CPU memory usage: 624.3MB, max: 911.3MB CPU: 30% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.2kB/s Size: 9.1MB) (Connections: 58 Fds: 273 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 19% Nice: 0% System: 5% Wait: 0% DAIActiveprocs: 1 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:39:14,514 C: 23% D:903.8GB M:244.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 171.7GB, since last ping: 2.4MB/s. CPU memory usage: 625.8MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.7kB/s Size: 9.1MB) (Connections: 58 Fds: 273 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 5% Wait: 1% DAIActiveprocs: 3 DAIprocs: 25) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:40:19,400 C: 21% D:901.2GB M:243.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 175.7GB, since last ping: 7.9MB/s. CPU memory usage: 623.8MB, max: 911.3MB CPU: 109% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 9.1MB) (Connections: 58 Fds: 274 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 4% Wait: 1% DAIActiveprocs: 2 DAIprocs: 25) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:41:21,066 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:41:21,072 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:41:21,074 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:41:21,557 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 324.23117 seconds. 2021-08-20 01:41:21,568 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:41:21,571 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:41:21,638 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:41:21,644 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.07327 seconds. 2021-08-20 01:41:21,647 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.07849 seconds. 2021-08-20 01:41:21,908 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 2 15 and Completed 17 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:41:21,912 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:41:21,914 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Time: 314.584 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 0.0, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:41:21,917 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:41:21,919 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | Time: 314.584 s: LIGHTGBM 2021-08-20 01:41:22,014 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:41:22,017 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:41:22,019 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:41:22,054 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:41:22,559 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 315.07212 seconds. 2021-08-20 01:41:22,571 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:41:22,573 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:41:22,642 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:41:22,653 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07738 seconds. 2021-08-20 01:41:22,656 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08484 seconds. 2021-08-20 01:41:22,999 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:41:25,259 C: 24% D:900.0GB M:244.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 178.8GB, since last ping: 2.6MB/s. CPU memory usage: 622.6MB, max: 911.3MB CPU: 119% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 21 (Disk: Read: 0B/s Write: 33.1kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 7% Wait: 0% DAIActiveprocs: 2 DAIprocs: 25) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_4] 2021-08-20 01:42:31,045 C: 21% D:938.7GB M:247.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 180.9GB, since last ping: 191.4kB/s. CPU memory usage: 624.3MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.6kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 6% Wait: 1% DAIActiveprocs: 2 DAIprocs: 28) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_4] 2021-08-20 01:43:17,856 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:17,861 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:43:17,863 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:43:18,321 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 115.32185 seconds. 2021-08-20 01:43:18,333 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:43:18,335 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:43:18,436 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:43:18,446 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.10915 seconds. 2021-08-20 01:43:18,450 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.11598 seconds. 2021-08-20 01:43:18,724 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 4 17 and Completed 19 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:18,727 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:43:18,730 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Time: 116.823 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 0.0, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:43:18,733 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:43:18,735 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Time: 116.823 s: LIGHTGBM 2021-08-20 01:43:18,757 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:18,759 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:43:18,761 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:43:18,897 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:43:19,231 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 117.17830 seconds. 2021-08-20 01:43:19,252 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:43:19,256 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:43:19,332 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:19,341 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08591 seconds. 2021-08-20 01:43:19,343 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.09297 seconds. 2021-08-20 01:43:19,676 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:19,678 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:43:19,680 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:43:19,711 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:43:20,114 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.21740 seconds. 2021-08-20 01:43:20,128 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:43:20,131 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:43:20,204 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 282 iterations: 282 2021-08-20 01:43:20,211 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07997 seconds. 2021-08-20 01:43:20,213 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08555 seconds. 2021-08-20 01:43:20,553 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:43:20,555 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:43:20,557 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:43:20,582 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) start. 2021-08-20 01:43:21,037 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.32579 seconds. 2021-08-20 01:43:21,047 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:43:21,049 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:43:21,120 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:21,127 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07701 seconds. 2021-08-20 01:43:21,130 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08236 seconds. 2021-08-20 01:43:21,472 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:21,497 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:21,500 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:43:21,503 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:22,866 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) end. Took 2.28410 seconds. 2021-08-20 01:43:22,878 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) start. 2021-08-20 01:43:22,880 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) start. 2021-08-20 01:43:22,946 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 128 iterations: 128 2021-08-20 01:43:22,954 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) end. Took 0.07360 seconds. 2021-08-20 01:43:22,955 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) end. Took 0.07838 seconds. 2021-08-20 01:43:23,279 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:23,384 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:23,386 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:43:23,389 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:25,229 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 3.75322 seconds. 2021-08-20 01:43:25,243 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:25,246 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:25,316 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 181 iterations: 181 2021-08-20 01:43:25,329 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.08152 seconds. 2021-08-20 01:43:25,332 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08845 seconds. 2021-08-20 01:43:25,676 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:25,679 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:43:25,681 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:25,719 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) start. 2021-08-20 01:43:26,894 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 3.61327 seconds. 2021-08-20 01:43:26,906 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:26,909 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:26,984 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:43:26,992 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.08237 seconds. 2021-08-20 01:43:26,994 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08799 seconds. 2021-08-20 01:43:27,375 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:27,881 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:27,885 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:43:27,888 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:28,973 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) end. Took 3.25070 seconds. 2021-08-20 01:43:28,988 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) start. 2021-08-20 01:43:28,991 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) start. 2021-08-20 01:43:29,074 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:43:29,084 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) end. Took 0.09142 seconds. 2021-08-20 01:43:29,087 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) end. Took 0.09886 seconds. 2021-08-20 01:43:29,334 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 5 24 and Completed 26 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:29,427 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:29,431 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:43:29,434 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:29,507 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:30,628 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 3.25165 seconds. 2021-08-20 01:43:30,642 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:30,645 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:30,717 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 116 iterations: 116 2021-08-20 01:43:30,724 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.07892 seconds. 2021-08-20 01:43:30,726 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08465 seconds. 2021-08-20 01:43:31,057 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:43:31,060 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:43:31,063 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:31,952 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 2.44502 seconds. 2021-08-20 01:43:31,964 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:31,967 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:32,037 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 88 iterations: 88 2021-08-20 01:43:32,043 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.07540 seconds. 2021-08-20 01:43:32,045 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08079 seconds. 2021-08-20 01:43:32,224 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:34,231 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 146, model transformed features: 9, total model time: 251.15, fit model time: 251.15 2021-08-20 01:43:34,240 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 106, model transformed features: 9, total model time: 278.68, fit model time: 278.67 2021-08-20 01:43:34,242 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 175, model transformed features: 9, total model time: 29.353, fit model time: 29.352 2021-08-20 01:43:34,244 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 9, total model time: 100.74, fit model time: 100.74 2021-08-20 01:43:34,246 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 102, model transformed features: 9, total model time: 11.838, fit model time: 11.837 2021-08-20 01:43:34,248 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 107, model transformed features: 9, total model time: 111.99, fit model time: 111.99 2021-08-20 01:43:34,250 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 62, model transformed features: 6, total model time: 89.533, fit model time: 89.532 2021-08-20 01:43:34,252 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 89, model transformed features: 6, total model time: 404.61, fit model time: 404.61 2021-08-20 01:43:34,254 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 96, model transformed features: 6, total model time: 317.23, fit model time: 317.23 2021-08-20 01:43:34,256 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 92, model transformed features: 6, total model time: 1.8405, fit model time: 1.8397 2021-08-20 01:43:34,258 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 76, model transformed features: 6, total model time: 93.855, fit model time: 93.854 2021-08-20 01:43:34,260 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 84, model transformed features: 6, total model time: 103.03, fit model time: 103.03 2021-08-20 01:43:34,262 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 324.52, fit model time: 324.52 2021-08-20 01:43:34,264 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 315.38, fit model time: 315.38 2021-08-20 01:43:34,266 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 13, total model time: 115.67, fit model time: 115.67 2021-08-20 01:43:34,268 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 117.49, fit model time: 117.49 2021-08-20 01:43:34,269 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 282, model transformed features: 13, total model time: 1.543, fit model time: 1.5421 2021-08-20 01:43:34,271 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.6259, fit model time: 1.625 2021-08-20 01:43:34,273 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 128, model transformed features: 12, total model time: 2.5919, fit model time: 2.591 2021-08-20 01:43:34,275 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 181, model transformed features: 12, total model time: 4.0555, fit model time: 4.0546 2021-08-20 01:43:34,277 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 12, total model time: 3.9001, fit model time: 3.899 2021-08-20 01:43:34,279 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 12, total model time: 3.6019, fit model time: 3.6009 2021-08-20 01:43:34,281 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 116, model transformed features: 12, total model time: 3.5585, fit model time: 3.5575 2021-08-20 01:43:34,282 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 88, model transformed features: 12, total model time: 2.7721, fit model time: 2.7713 2021-08-20 01:43:34,769 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,811 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,862 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6172 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,897 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=2.0596 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,938 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,971 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6467 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:35,852 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:35,879 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:36,571 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Munge time: 0.0447 s, Train time: 1348.0671 s, Score time: 2.2880 s 2021-08-20 01:43:36,997 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:43:37,128 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 182.3GB, since last ping: 12.9MB/s. CPU memory usage: 696.5MB, max: 911.3MB CPU: 39% Procs: 3 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/3145728 (OpenFilesUser: 0) PSThreads: 24 (Disk: Read: 0B/s Write: 341.1kB/s Size: 9.1MB) (Connections: 47 Fds: 271 WinHandles: 0 Threads: 17 Maps: 3229 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 4% Wait: 1% DAIActiveprocs: 1 DAIprocs: 23) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_Evolution] 2021-08-20 01:43:37,373 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:43:37,386 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:43:37,388 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Time so far: 3287 secs 2021-08-20 01:43:37,391 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Stopping in: 83112 secs 2021-08-20 01:43:37,445 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 45.6 % 2021-08-20 01:43:37,526 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Scored 163/310 models on 29 features. Last Scored [LIGHTGBM] 2021-08-20 01:43:37,535 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:43:37,538 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.56956 +/- 0.07548585 [Tournament: 1.56956 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:43:37,540 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.569788 +/- 0.07548585 [Tournament: 1.569788 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:43:37,542 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.617236 +/- 0.06588676 [Tournament: 1.617236 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:43:37,544 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:43:37,546 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:43:37,548 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.64671 +/- 0.05861774 [Tournament: 1.64671 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:43:37,551 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:43:37,553 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7 : 2.059576 +/- 0.04058437 [Tournament: 2.059576 Model: LIGHTGBM Feature Cost: 6] 2021-08-20 01:43:37,555 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 10 transformers creating 13 total features and 13 features for model: 1.56956 RMSE 2021-08-20 01:43:37,557 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:43:37,559 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:43:37,561 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:43:37,563 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.555859 2021-08-20 01:43:37,565 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 2 10_InteractionAdd:X_0:X_1 0.391387 2021-08-20 01:43:37,567 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.266291 2021-08-20 01:43:37,570 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.178320 2021-08-20 01:43:37,573 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 5 1_X_1 0.064184 2021-08-20 01:43:37,575 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 6 0_X_0 0.040219 2021-08-20 01:43:37,577 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 7 10_InteractionSub:X_0:X_1 0.032582 2021-08-20 01:43:37,580 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.005531 2021-08-20 01:43:37,582 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_0:X_1 0.004636 2021-08-20 01:43:37,586 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:43:37,588 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:43:37,590 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 12 2021-08-20 01:43:37,593 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:43:40,040 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:43:40,062 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed 84 munging tasks out of 84 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:43:40,320 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:43:40,405 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:43:40,583 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:40,586 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708'} 2021-08-20 01:43:40,588 C: 19% D:943.2GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:43:41,084 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 0.76372 seconds. 2021-08-20 01:43:41,095 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:43:41,097 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:43:41,167 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 190 iterations: 190 2021-08-20 01:43:41,175 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.07604 seconds. 2021-08-20 01:43:41,179 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08300 seconds. 2021-08-20 01:43:41,530 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:41,535 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737'} 2021-08-20 01:43:41,539 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:43:41,544 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:43:41,945 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.54098 seconds. 2021-08-20 01:43:41,959 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:43:41,962 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:43:42,032 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 209 iterations: 209 2021-08-20 01:43:42,039 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07699 seconds. 2021-08-20 01:43:42,042 C: 20% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08326 seconds. 2021-08-20 01:43:42,360 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:42,366 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792'} 2021-08-20 01:43:42,368 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:43:42,439 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:43:42,836 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.29389 seconds. 2021-08-20 01:43:42,847 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:43:42,850 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:43:42,917 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 290 iterations: 290 2021-08-20 01:43:42,923 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07312 seconds. 2021-08-20 01:43:42,925 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.07800 seconds. 2021-08-20 01:43:43,259 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:43,262 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371'} 2021-08-20 01:43:43,265 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:43:43,280 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:43:43,653 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.21307 seconds. 2021-08-20 01:43:43,670 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:43:43,674 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:43:43,745 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 214 iterations: 214 2021-08-20 01:43:43,752 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.07842 seconds. 2021-08-20 01:43:43,754 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08531 seconds. 2021-08-20 01:43:44,111 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:44,113 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112'} 2021-08-20 01:43:44,115 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:43:44,142 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:43:44,550 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.26996 seconds. 2021-08-20 01:43:44,563 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:43:44,566 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:43:44,626 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 228 iterations: 228 2021-08-20 01:43:44,634 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.06696 seconds. 2021-08-20 01:43:44,636 C: 19% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.07342 seconds. 2021-08-20 01:43:45,028 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:43:45,110 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:45,113 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786'} 2021-08-20 01:43:45,115 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:43:45,598 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.45507 seconds. 2021-08-20 01:43:45,609 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:43:45,612 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:43:45,690 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 288 iterations: 288 2021-08-20 01:43:45,697 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.08457 seconds. 2021-08-20 01:43:45,700 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.09064 seconds. 2021-08-20 01:43:46,034 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:46,043 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708'} 2021-08-20 01:43:46,045 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:43:46,082 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:43:46,385 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 1.35725 seconds. 2021-08-20 01:43:46,399 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:43:46,402 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:43:46,481 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 95 iterations: 95 2021-08-20 01:43:46,488 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.08544 seconds. 2021-08-20 01:43:46,492 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.09241 seconds. 2021-08-20 01:43:46,807 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:46,809 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737'} 2021-08-20 01:43:46,813 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:43:46,858 C: 17% D:943.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:43:47,189 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.10664 seconds. 2021-08-20 01:43:47,203 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:43:47,206 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:43:47,272 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 165 iterations: 165 2021-08-20 01:43:47,278 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07197 seconds. 2021-08-20 01:43:47,280 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07734 seconds. 2021-08-20 01:43:47,617 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:47,619 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792'} 2021-08-20 01:43:47,621 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:43:47,652 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:43:47,977 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.11833 seconds. 2021-08-20 01:43:47,991 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:43:47,994 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:43:48,061 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:43:48,067 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07265 seconds. 2021-08-20 01:43:48,070 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07887 seconds. 2021-08-20 01:43:48,448 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:43:48,490 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:48,493 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371'} 2021-08-20 01:43:48,495 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:43:48,833 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 1.18140 seconds. 2021-08-20 01:43:48,844 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:43:48,847 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:43:48,910 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:43:48,917 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.06891 seconds. 2021-08-20 01:43:48,921 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.07547 seconds. 2021-08-20 01:43:49,247 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:49,249 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112'} 2021-08-20 01:43:49,252 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:43:49,289 C: 16% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:43:49,566 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.12412 seconds. 2021-08-20 01:43:49,579 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:43:49,582 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:43:49,661 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 85 iterations: 85 2021-08-20 01:43:49,668 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.08503 seconds. 2021-08-20 01:43:49,671 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.09165 seconds. 2021-08-20 01:43:49,998 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:43:50,001 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786'} 2021-08-20 01:43:50,004 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:43:50,061 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:43:50,400 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.11091 seconds. 2021-08-20 01:43:50,415 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:43:50,419 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:43:50,488 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 190 iterations: 190 2021-08-20 01:43:50,493 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07466 seconds. 2021-08-20 01:43:50,495 C: 18% D:943.2GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08061 seconds. 2021-08-20 01:43:50,724 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 1 14 and Completed 16 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:50,765 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:50,772 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:43:50,775 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:43:50,860 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:43:51,215 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.15502 seconds. 2021-08-20 01:43:51,226 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:43:51,229 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:43:51,295 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:51,302 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07327 seconds. 2021-08-20 01:43:51,304 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.07827 seconds. 2021-08-20 01:43:51,650 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:51,653 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:43:51,656 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:43:51,679 C: 17% D:943.1GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:43:52,094 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.23596 seconds. 2021-08-20 01:43:52,109 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:43:52,114 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:43:52,188 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:43:52,199 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08450 seconds. 2021-08-20 01:43:52,203 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09282 seconds. 2021-08-20 01:43:52,537 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:52,539 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:43:52,542 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:43:52,625 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:43:53,027 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.34837 seconds. 2021-08-20 01:43:53,038 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:43:53,040 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:43:53,117 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:53,128 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08578 seconds. 2021-08-20 01:43:53,131 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09256 seconds. 2021-08-20 01:43:53,521 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:43:54,087 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:54,091 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:43:54,094 C: 18% D:943.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:43:54,582 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.96025 seconds. 2021-08-20 01:43:54,593 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:43:54,596 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:43:54,665 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:54,674 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07723 seconds. 2021-08-20 01:43:54,677 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08303 seconds. 2021-08-20 01:43:54,948 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:54,950 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:43:54,952 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:43:55,079 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:43:55,438 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.91747 seconds. 2021-08-20 01:43:55,449 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:43:55,452 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:43:55,517 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:55,528 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07391 seconds. 2021-08-20 01:43:55,531 C: 13% D:943.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08068 seconds. 2021-08-20 01:43:55,859 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:55,868 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:43:55,870 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:43:55,914 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) start. 2021-08-20 01:43:56,339 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.26155 seconds. 2021-08-20 01:43:56,350 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:43:56,353 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:43:56,424 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 294 iterations: 294 2021-08-20 01:43:56,435 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08002 seconds. 2021-08-20 01:43:56,439 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08736 seconds. 2021-08-20 01:43:56,739 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:56,743 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:43:56,747 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:56,799 C: 17% D:943.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:43:57,217 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) end. Took 1.30364 seconds. 2021-08-20 01:43:57,228 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) start. 2021-08-20 01:43:57,230 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) start. 2021-08-20 01:43:57,298 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:57,308 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) end. Took 0.07591 seconds. 2021-08-20 01:43:57,312 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) end. Took 0.08275 seconds. 2021-08-20 01:43:57,630 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:57,633 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:43:57,636 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:57,722 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:43:58,069 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 1.27008 seconds. 2021-08-20 01:43:58,079 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:43:58,082 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:43:58,150 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 280 iterations: 280 2021-08-20 01:43:58,163 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.07596 seconds. 2021-08-20 01:43:58,168 C: 16% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.08642 seconds. 2021-08-20 01:43:58,568 C: 17% D:942.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) start. 2021-08-20 01:43:59,676 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:59,681 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:43:59,683 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:00,144 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 2.42331 seconds. 2021-08-20 01:44:00,165 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:44:00,168 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:44:00,239 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:44:00,245 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.07750 seconds. 2021-08-20 01:44:00,249 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.08453 seconds. 2021-08-20 01:44:00,582 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:00,584 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:44:00,586 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:00,633 C: 12% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:44:01,005 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) end. Took 2.43839 seconds. 2021-08-20 01:44:01,020 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) start. 2021-08-20 01:44:01,025 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) start. 2021-08-20 01:44:01,108 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 280 iterations: 280 2021-08-20 01:44:01,118 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) end. Took 0.09253 seconds. 2021-08-20 01:44:01,121 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) end. Took 0.10002 seconds. 2021-08-20 01:44:01,419 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 7 fold_id= 5 24 and Completed 26 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:44:01,572 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:44:01,587 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:01,589 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:44:01,592 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:02,000 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 1.41786 seconds. 2021-08-20 01:44:02,011 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:44:02,019 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:44:02,081 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:44:02,092 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.07784 seconds. 2021-08-20 01:44:02,096 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.08345 seconds. 2021-08-20 01:44:02,415 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:02,417 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:44:02,420 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:02,870 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 1.29803 seconds. 2021-08-20 01:44:02,882 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:44:02,884 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:44:02,964 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:44:02,970 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.08607 seconds. 2021-08-20 01:44:02,973 C: 20% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.09118 seconds. 2021-08-20 01:44:03,148 C: 17% D:942.8GB M:248.7GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:44:05,199 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 190, model transformed features: 6, total model time: 1.0788, fit model time: 1.078 2021-08-20 01:44:05,208 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 209, model transformed features: 6, total model time: 1.8471, fit model time: 1.8457 2021-08-20 01:44:05,211 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 290, model transformed features: 6, total model time: 1.5974, fit model time: 1.5967 2021-08-20 01:44:05,213 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 214, model transformed features: 6, total model time: 1.5309, fit model time: 1.53 2021-08-20 01:44:05,216 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 228, model transformed features: 6, total model time: 1.5633, fit model time: 1.5622 2021-08-20 01:44:05,218 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 288, model transformed features: 6, total model time: 1.7938, fit model time: 1.7929 2021-08-20 01:44:05,220 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 95, model transformed features: 5, total model time: 1.6717, fit model time: 1.6709 2021-08-20 01:44:05,223 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 165, model transformed features: 5, total model time: 1.4187, fit model time: 1.4179 2021-08-20 01:44:05,225 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 139, model transformed features: 5, total model time: 1.4213, fit model time: 1.42 2021-08-20 01:44:05,227 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 108, model transformed features: 5, total model time: 1.4605, fit model time: 1.4596 2021-08-20 01:44:05,230 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 85, model transformed features: 5, total model time: 1.4631, fit model time: 1.462 2021-08-20 01:44:05,232 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 190, model transformed features: 5, total model time: 1.4093, fit model time: 1.4084 2021-08-20 01:44:05,234 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.471, fit model time: 1.4701 2021-08-20 01:44:05,237 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 9, total model time: 1.5396, fit model time: 1.5387 2021-08-20 01:44:05,239 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.6837, fit model time: 1.6824 2021-08-20 01:44:05,241 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 2.2882, fit model time: 2.2873 2021-08-20 01:44:05,244 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 2.2432, fit model time: 2.2423 2021-08-20 01:44:05,246 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 294, model transformed features: 9, total model time: 1.592, fit model time: 1.5908 2021-08-20 01:44:05,248 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 300, model transformed features: 7, total model time: 1.638, fit model time: 1.637 2021-08-20 01:44:05,251 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 280, model transformed features: 7, total model time: 1.6025, fit model time: 1.6015 2021-08-20 01:44:05,253 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 300, model transformed features: 7, total model time: 2.7456, fit model time: 2.7448 2021-08-20 01:44:05,256 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 280, model transformed features: 7, total model time: 2.7864, fit model time: 2.7856 2021-08-20 01:44:05,258 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 300, model transformed features: 7, total model time: 1.7262, fit model time: 1.725 2021-08-20 01:44:05,260 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 300, model transformed features: 7, total model time: 1.6147, fit model time: 1.6139 2021-08-20 01:44:05,744 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=2.1902 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:05,794 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.5698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:05,808 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=2.5621 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:05,869 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:05,911 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5421 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:05,945 C: 17% D:942.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6172 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:06,790 C: 17% D:942.4GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6467 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:06,847 C: 17% D:942.4GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.7544 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:44:07,640 C: 17% D:942.4GB M:248.7GB NODE:LOCAL1 7646 INFO | Munge time: 0.0610 s, Train time: 23.0775 s, Score time: 2.3510 s 2021-08-20 01:44:08,042 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:44:08,412 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:44:08,424 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:44:08,426 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Time so far: 3318 secs 2021-08-20 01:44:08,429 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Stopping in: 83081 secs 2021-08-20 01:44:08,482 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Experiment Progress: 52.3 % 2021-08-20 01:44:08,556 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Scored 187/310 models on 29 features. Last Scored [LIGHTGBM] 2021-08-20 01:44:08,564 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:44:08,566 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.542085 +/- 0.07796533 [Tournament: 1.542085 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:44:08,569 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.56956 +/- 0.07548585 [Tournament: 1.56956 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:44:08,571 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.569788 +/- 0.07548585 [Tournament: 1.569788 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:44:08,574 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.617236 +/- 0.06588676 [Tournament: 1.617236 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:44:08,576 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.64671 +/- 0.05861774 [Tournament: 1.64671 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:44:08,579 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.754419 +/- 0.09333494 [Tournament: 1.754419 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:44:08,581 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 6 : 2.190192 +/- 0.08906121 [Tournament: 2.190192 Model: LIGHTGBM Feature Cost: 6] 2021-08-20 01:44:08,583 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 7 : 2.562105 +/- 0.0511174 [Tournament: 2.562105 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:44:08,586 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 6 transformers creating 9 total features and 9 features for model: 1.542085 RMSE 2021-08-20 01:44:08,588 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Top 9 variable importances of best individual: 2021-08-20 01:44:08,590 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:44:08,592 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:44:08,594 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.768475 2021-08-20 01:44:08,596 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.282241 2021-08-20 01:44:08,599 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 3 10_InteractionAdd:X_0:X_1 0.226147 2021-08-20 01:44:08,601 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.175828 2021-08-20 01:44:08,603 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 5 0_X_0 0.068387 2021-08-20 01:44:08,605 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 6 1_X_1 0.051803 2021-08-20 01:44:08,607 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 7 10_InteractionSub:X_0:X_1 0.013452 2021-08-20 01:44:08,609 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 DATA | 8 10_InteractionDiv:X_0:X_1 0.009286 2021-08-20 01:44:08,611 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Experiment has not yet converged after 12 iteration(s). Last few scores: ['1.63852', '1.63852', '1.63852', '1.63849', '1.63849', '1.63852', '1.63852', '1.61909', '1.61909', '1.56956', '1.56956', '1.54208'] 2021-08-20 01:44:08,614 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:44:08,616 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:44:08,618 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | Starting Iteration: 13 2021-08-20 01:44:08,621 C: 15% D:942.1GB M:248.8GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:44:11,045 C: 18% D:941.6GB M:248.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:44:12,565 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 INFO | Completed 108 munging tasks out of 108 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:44:12,583 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1032256030', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 16) 2021-08-20 01:44:12,587 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:44:12,592 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='983370933', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 17) 2021-08-20 01:44:12,596 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:44:12,876 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) start. 2021-08-20 01:44:12,953 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:44:13,144 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:13,147 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:44:13,149 C: 13% D:941.3GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:44:13,826 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) end. Took 0.94974 seconds. 2021-08-20 01:44:13,844 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) start. 2021-08-20 01:44:13,847 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) start. 2021-08-20 01:44:13,925 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:44:13,934 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) end. Took 0.08633 seconds. 2021-08-20 01:44:13,937 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) end. Took 0.09387 seconds. 2021-08-20 01:44:14,254 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:14,259 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:44:14,262 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:44:14,300 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:44:14,764 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 1.81119 seconds. 2021-08-20 01:44:14,777 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:44:14,781 C: 18% D:940.9GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:44:14,866 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:44:14,876 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.09242 seconds. 2021-08-20 01:44:14,878 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.09939 seconds. 2021-08-20 01:44:15,249 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) start. 2021-08-20 01:44:15,331 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:15,333 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:44:15,335 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:44:15,767 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 1.46611 seconds. 2021-08-20 01:44:15,778 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:44:15,781 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:44:15,851 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:44:15,863 C: 16% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.07946 seconds. 2021-08-20 01:44:15,867 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08707 seconds. 2021-08-20 01:44:16,164 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:16,166 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:44:16,170 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:44:16,215 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:44:16,633 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) end. Took 1.38345 seconds. 2021-08-20 01:44:16,644 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) start. 2021-08-20 01:44:16,646 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) start. 2021-08-20 01:44:16,714 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 282 iterations: 282 2021-08-20 01:44:16,726 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) end. Took 0.07675 seconds. 2021-08-20 01:44:16,730 C: 17% D:940.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) end. Took 0.08459 seconds. 2021-08-20 01:44:17,036 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:17,043 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:44:17,045 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:44:17,120 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:44:17,468 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 1.25342 seconds. 2021-08-20 01:44:17,478 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:44:17,481 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:44:17,565 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:44:17,576 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.09354 seconds. 2021-08-20 01:44:17,580 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.10033 seconds. 2021-08-20 01:44:17,964 C: 19% D:940.6GB M:247.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:44:18,063 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:44:18,072 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:44:18,074 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:44:18,579 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 1.46115 seconds. 2021-08-20 01:44:18,592 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:44:18,594 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:44:18,664 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:44:18,676 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.07911 seconds. 2021-08-20 01:44:18,680 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08695 seconds. 2021-08-20 01:44:19,007 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:44:19,011 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024'} 2021-08-20 01:44:19,015 C: 17% D:940.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:19,078 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:44:19,337 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 1.37342 seconds. 2021-08-20 01:44:19,348 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:44:19,350 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:44:19,413 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 58 iterations: 58 2021-08-20 01:44:19,417 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.06682 seconds. 2021-08-20 01:44:19,420 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.07200 seconds. 2021-08-20 01:44:19,773 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:44:19,776 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019'} 2021-08-20 01:44:19,778 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:19,798 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:44:20,119 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.04003 seconds. 2021-08-20 01:44:20,136 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:44:20,140 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:44:20,212 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 72 iterations: 72 2021-08-20 01:44:20,219 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07827 seconds. 2021-08-20 01:44:20,222 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08647 seconds. 2021-08-20 01:44:20,594 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:44:20,654 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1} 2021-08-20 01:44:20,657 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084'} 2021-08-20 01:44:20,660 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:20,995 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.19764 seconds. 2021-08-20 01:44:21,009 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:44:21,012 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:44:21,080 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 90 iterations: 90 2021-08-20 01:44:21,086 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07363 seconds. 2021-08-20 01:44:21,088 C: 17% D:939.9GB M:247.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08012 seconds. 2021-08-20 01:44:21,447 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:44:21,503 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1} 2021-08-20 01:44:21,507 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763'} 2021-08-20 01:44:21,511 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:21,856 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 1.26193 seconds. 2021-08-20 01:44:21,867 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:44:21,869 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:44:21,948 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 64 iterations: 64 2021-08-20 01:44:21,955 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.08395 seconds. 2021-08-20 01:44:21,958 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.09036 seconds. 2021-08-20 01:44:22,295 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:44:22,297 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996'} 2021-08-20 01:44:22,300 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:22,324 C: 16% D:939.9GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:44:22,628 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.18075 seconds. 2021-08-20 01:44:22,646 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:44:22,650 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:44:22,732 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 75 iterations: 75 2021-08-20 01:44:22,739 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.08895 seconds. 2021-08-20 01:44:22,742 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.09633 seconds. 2021-08-20 01:44:22,996 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 0 13 and Completed 15 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:44:23,051 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1} 2021-08-20 01:44:23,054 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321'} 2021-08-20 01:44:23,056 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:23,195 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) start. 2021-08-20 01:44:23,390 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.06574 seconds. 2021-08-20 01:44:23,402 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:44:23,404 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:44:23,471 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 70 iterations: 70 2021-08-20 01:44:23,478 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07295 seconds. 2021-08-20 01:44:23,482 C: 16% D:939.9GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07962 seconds. 2021-08-20 01:44:23,798 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:44:23,806 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.56708'} 2021-08-20 01:44:23,808 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:23,872 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:44:24,092 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) end. Took 0.89650 seconds. 2021-08-20 01:44:24,102 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) start. 2021-08-20 01:44:24,107 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) start. 2021-08-20 01:44:24,182 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 90 iterations: 90 2021-08-20 01:44:24,188 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) end. Took 0.08220 seconds. 2021-08-20 01:44:24,191 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) end. Took 0.08862 seconds. 2021-08-20 01:44:24,516 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:44:24,518 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.58737'} 2021-08-20 01:44:24,521 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:24,583 C: 17% D:939.7GB M:248.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:44:24,839 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 0.96721 seconds. 2021-08-20 01:44:24,850 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:44:24,853 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:44:24,921 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 70 iterations: 70 2021-08-20 01:44:24,927 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.07329 seconds. 2021-08-20 01:44:24,930 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.07980 seconds. 2021-08-20 01:44:25,267 C: 16% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) start. 2021-08-20 01:44:25,910 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:44:25,916 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.60792'} 2021-08-20 01:44:25,917 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:26,203 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.62023 seconds. 2021-08-20 01:44:26,216 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:44:26,221 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:44:26,294 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 44 iterations: 44 2021-08-20 01:44:26,302 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.08123 seconds. 2021-08-20 01:44:26,306 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.08904 seconds. 2021-08-20 01:44:26,664 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:44:26,756 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:44:26,759 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.60371'} 2021-08-20 01:44:26,761 C: 14% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:27,095 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) end. Took 1.82805 seconds. 2021-08-20 01:44:27,105 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) start. 2021-08-20 01:44:27,108 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) start. 2021-08-20 01:44:27,179 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 58 iterations: 58 2021-08-20 01:44:27,185 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) end. Took 0.07624 seconds. 2021-08-20 01:44:27,187 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) end. Took 0.08239 seconds. 2021-08-20 01:44:27,519 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:44:27,523 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.57112'} 2021-08-20 01:44:27,526 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:27,569 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:44:27,849 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.18494 seconds. 2021-08-20 01:44:27,868 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:44:27,872 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:44:27,945 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 101 iterations: 101 2021-08-20 01:44:27,954 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.08101 seconds. 2021-08-20 01:44:27,958 C: 18% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.08956 seconds. 2021-08-20 01:44:28,302 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:44:28,308 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.58786'} 2021-08-20 01:44:28,310 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:28,332 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:44:28,668 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.09919 seconds. 2021-08-20 01:44:28,680 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:44:28,683 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:44:28,752 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 87 iterations: 87 2021-08-20 01:44:28,757 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.07422 seconds. 2021-08-20 01:44:28,760 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.07957 seconds. 2021-08-20 01:44:29,117 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:44:29,188 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:29,191 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:44:29,194 C: 18% D:939.6GB M:248.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:29,704 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.37116 seconds. 2021-08-20 01:44:29,715 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:44:29,717 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:44:29,787 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 285 iterations: 285 2021-08-20 01:44:29,794 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07686 seconds. 2021-08-20 01:44:29,797 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08217 seconds. 2021-08-20 01:44:30,156 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:30,159 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:44:30,161 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:30,186 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:44:30,655 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.53751 seconds. 2021-08-20 01:44:30,666 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:44:30,670 C: 19% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:44:30,736 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 249 iterations: 249 2021-08-20 01:44:30,746 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07479 seconds. 2021-08-20 01:44:30,748 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08130 seconds. 2021-08-20 01:44:31,138 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:44:31,275 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:31,279 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:44:31,283 C: 20% D:939.6GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:35,815 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.56292 seconds. 2021-08-20 01:44:35,835 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:44:35,839 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:44:35,921 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 180 iterations: 180 2021-08-20 01:44:35,929 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.09046 seconds. 2021-08-20 01:44:35,931 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09821 seconds. 2021-08-20 01:44:36,168 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 4 23 and Completed 25 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:44:36,316 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:44:36,354 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:36,356 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:44:36,359 C: 8% D:939.6GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:36,907 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 5.76872 seconds. 2021-08-20 01:44:36,919 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:44:36,921 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:44:37,000 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 269 iterations: 269 2021-08-20 01:44:37,007 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.08558 seconds. 2021-08-20 01:44:37,009 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.09075 seconds. 2021-08-20 01:44:37,386 C: 20% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:44:41,890 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:41,897 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:44:41,899 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:42,379 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 6.06262 seconds. 2021-08-20 01:44:42,389 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:44:42,391 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:44:42,472 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 220 iterations: 220 2021-08-20 01:44:42,478 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08668 seconds. 2021-08-20 01:44:42,481 C: 12% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09145 seconds. 2021-08-20 01:44:44,394 C: 15% D:939.6GB M:248.7GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 183.6GB, since last ping: 13.1MB/s. CPU memory usage: 631.8MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 25 (Disk: Read: 0B/s Write: 72.4kB/s Size: 9.3MB) (Connections: 58 Fds: 295 WinHandles: 0 Threads: 21 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 7% Nice: 0% System: 3% Wait: 8% DAIActiveprocs: 0 DAIprocs: 24) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_13)_score_train 1 (1) (True) [] []] 2021-08-20 01:44:45,533 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:44:45,542 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:44:45,544 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:44:46,166 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 8.66345 seconds. 2021-08-20 01:44:46,187 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:44:46,191 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:44:46,268 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 260 iterations: 260 2021-08-20 01:44:46,278 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08595 seconds. 2021-08-20 01:44:46,282 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09487 seconds. 2021-08-20 01:44:46,485 C: 11% D:939.5GB M:248.7GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:44:59,944 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 12, total model time: 1.2833, fit model time: 1.2825 2021-08-20 01:44:59,954 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 12, total model time: 2.1508, fit model time: 2.1498 2021-08-20 01:44:59,957 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 12, total model time: 1.7741, fit model time: 1.7728 2021-08-20 01:44:59,959 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 282, model transformed features: 12, total model time: 1.7026, fit model time: 1.7015 2021-08-20 01:44:59,961 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 12, total model time: 1.5757, fit model time: 1.5747 2021-08-20 01:44:59,964 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 12, total model time: 1.8045, fit model time: 1.8035 2021-08-20 01:44:59,966 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 58, model transformed features: 5, total model time: 1.6777, fit model time: 1.6768 2021-08-20 01:44:59,968 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 72, model transformed features: 5, total model time: 1.3837, fit model time: 1.3828 2021-08-20 01:44:59,970 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 90, model transformed features: 5, total model time: 1.5353, fit model time: 1.5344 2021-08-20 01:44:59,973 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 64, model transformed features: 5, total model time: 1.5677, fit model time: 1.5668 2021-08-20 01:44:59,975 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 75, model transformed features: 5, total model time: 1.5069, fit model time: 1.506 2021-08-20 01:44:59,977 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 70, model transformed features: 5, total model time: 1.3755, fit model time: 1.3742 2021-08-20 01:44:59,979 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 90, model transformed features: 1, total model time: 1.2053, fit model time: 1.2039 2021-08-20 01:44:59,981 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 70, model transformed features: 1, total model time: 1.2917, fit model time: 1.2908 2021-08-20 01:44:59,984 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 44, model transformed features: 1, total model time: 1.9628, fit model time: 1.9617 2021-08-20 01:44:59,986 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 58, model transformed features: 1, total model time: 2.1235, fit model time: 2.1225 2021-08-20 01:44:59,988 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 101, model transformed features: 1, total model time: 1.4949, fit model time: 1.4939 2021-08-20 01:44:59,990 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 87, model transformed features: 1, total model time: 1.4082, fit model time: 1.4074 2021-08-20 01:44:59,992 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 285, model transformed features: 9, total model time: 1.6862, fit model time: 1.6851 2021-08-20 01:44:59,994 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 249, model transformed features: 9, total model time: 1.8461, fit model time: 1.8452 2021-08-20 01:44:59,996 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 180, model transformed features: 9, total model time: 5.9725, fit model time: 5.9716 2021-08-20 01:44:59,998 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 269, model transformed features: 9, total model time: 6.0984, fit model time: 6.097 2021-08-20 01:45:00,000 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 220, model transformed features: 9, total model time: 6.3676, fit model time: 6.3667 2021-08-20 01:45:00,003 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 260, model transformed features: 9, total model time: 9.1231, fit model time: 9.1221 2021-08-20 01:45:00,568 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.5691 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:00,596 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=3.7830 LIGHTGBM ['InteractionsTransformer'] 2021-08-20 01:45:00,618 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=4.0398 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:45:00,650 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.5817 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:00,723 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:00,755 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6467 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:00,787 C: 12% D:939.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.5421 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:01,869 C: 16% D:939.4GB M:248.7GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.7544 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:02,447 C: 16% D:939.4GB M:248.7GB NODE:LOCAL1 7646 INFO | Munge time: 1.5794 s, Train time: 39.7523 s, Score time: 7.9502 s 2021-08-20 01:45:02,894 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:45:03,295 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:45:03,308 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:45:03,310 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Time so far: 3373 secs 2021-08-20 01:45:03,313 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Stopping in: 83026 secs 2021-08-20 01:45:03,356 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Experiment Progress: 59 % 2021-08-20 01:45:03,424 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Scored 211/310 models on 29 features. Last Scored [LIGHTGBM] 2021-08-20 01:45:03,436 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:45:03,438 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.542085 +/- 0.07796533 [Tournament: 1.542085 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:45:03,441 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.569123 +/- 0.06545132 [Tournament: 1.569123 Model: LIGHTGBM Feature Cost: 12] 2021-08-20 01:45:03,443 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.56956 +/- 0.07548585 [Tournament: 1.56956 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:45:03,446 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.58174 +/- 0.0470579 [Tournament: 1.58174 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:45:03,448 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.64671 +/- 0.05861774 [Tournament: 1.64671 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:45:03,450 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.754419 +/- 0.09333494 [Tournament: 1.754419 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:45:03,453 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 6 : 3.782966 +/- 0.07759839 [Tournament: 3.782966 Model: LIGHTGBM Feature Cost: 7] 2021-08-20 01:45:03,455 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Individual 7 : 4.039753 +/- 0.06485177 [Tournament: 4.039753 Model: LIGHTGBM Feature Cost: 1] 2021-08-20 01:45:03,458 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 6 transformers creating 9 total features and 9 features for model: 1.542085 RMSE 2021-08-20 01:45:03,460 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Top 9 variable importances of best individual: 2021-08-20 01:45:03,462 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:45:03,464 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:45:03,466 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.768475 2021-08-20 01:45:03,468 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.282241 2021-08-20 01:45:03,471 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 3 10_InteractionAdd:X_0:X_1 0.226147 2021-08-20 01:45:03,473 C: 13% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.175828 2021-08-20 01:45:05,657 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 5 0_X_0 0.068387 2021-08-20 01:45:05,666 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 6 1_X_1 0.051803 2021-08-20 01:45:05,668 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 7 10_InteractionSub:X_0:X_1 0.013452 2021-08-20 01:45:05,670 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | 8 10_InteractionDiv:X_0:X_1 0.009286 2021-08-20 01:45:05,674 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Experiment has not yet converged after 13 iteration(s). Last few scores: ['1.63852', '1.63852', '1.63849', '1.63849', '1.63852', '1.63852', '1.61909', '1.61909', '1.56956', '1.56956', '1.54208', '1.54208'] 2021-08-20 01:45:05,678 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:45:05,681 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:45:05,684 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Starting Iteration: 14 2021-08-20 01:45:05,687 C: 9% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:45:07,991 C: 19% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:45:09,111 C: 11% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | Completed 114 munging tasks out of 114 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:45:09,122 C: 11% D:939.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='3519124525', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (2, 0, 16) 2021-08-20 01:45:09,125 C: 11% D:939.4GB M:248.8GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:45:09,416 C: 11% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) start. 2021-08-20 01:45:09,483 C: 11% D:939.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:45:10,973 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:45:10,980 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708'} 2021-08-20 01:45:10,982 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:11,548 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) end. Took 2.12977 seconds. 2021-08-20 01:45:11,558 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) start. 2021-08-20 01:45:11,560 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) start. 2021-08-20 01:45:11,632 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 136 iterations: 136 2021-08-20 01:45:11,638 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) end. Took 0.07726 seconds. 2021-08-20 01:45:11,640 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) end. Took 0.08195 seconds. 2021-08-20 01:45:11,965 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:45:11,968 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737'} 2021-08-20 01:45:11,971 C: 11% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:11,987 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:45:12,515 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 3.03237 seconds. 2021-08-20 01:45:12,533 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:45:12,537 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:45:12,614 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:45:12,620 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.08371 seconds. 2021-08-20 01:45:12,623 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.09061 seconds. 2021-08-20 01:45:12,968 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1} 2021-08-20 01:45:12,971 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792'} 2021-08-20 01:45:12,974 C: 14% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:13,020 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) start. 2021-08-20 01:45:13,437 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 1.44775 seconds. 2021-08-20 01:45:13,449 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:45:13,452 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:45:13,523 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 117 iterations: 117 2021-08-20 01:45:13,530 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.07763 seconds. 2021-08-20 01:45:13,532 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.08318 seconds. 2021-08-20 01:45:13,848 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1} 2021-08-20 01:45:13,851 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371'} 2021-08-20 01:45:13,853 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:13,863 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:45:14,338 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 7) end. Took 1.31909 seconds. 2021-08-20 01:45:14,355 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) start. 2021-08-20 01:45:14,358 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) start. 2021-08-20 01:45:14,427 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:45:14,433 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 7) model predict (334, 7) end. Took 0.07503 seconds. 2021-08-20 01:45:14,435 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 8) end. Took 0.08143 seconds. 2021-08-20 01:45:14,761 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:45:14,765 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112'} 2021-08-20 01:45:14,768 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:14,858 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) start. 2021-08-20 01:45:15,277 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 1.41275 seconds. 2021-08-20 01:45:15,288 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:45:15,290 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:45:15,363 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 140 iterations: 140 2021-08-20 01:45:15,369 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.07824 seconds. 2021-08-20 01:45:15,372 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.08350 seconds. 2021-08-20 01:45:15,708 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1} 2021-08-20 01:45:15,711 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786'} 2021-08-20 01:45:15,713 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:15,753 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:45:16,156 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 7) end. Took 1.29909 seconds. 2021-08-20 01:45:16,174 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) start. 2021-08-20 01:45:16,178 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) start. 2021-08-20 01:45:16,251 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:45:16,260 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 7) model predict (333, 7) end. Took 0.08136 seconds. 2021-08-20 01:45:16,263 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 8) end. Took 0.08972 seconds. 2021-08-20 01:45:16,507 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:45:16,516 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708'} 2021-08-20 01:45:16,518 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:16,629 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:16,935 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.18168 seconds. 2021-08-20 01:45:16,946 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:45:16,948 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:45:17,023 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 156 iterations: 156 2021-08-20 01:45:17,029 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.08027 seconds. 2021-08-20 01:45:17,031 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08570 seconds. 2021-08-20 01:45:17,347 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:45:17,349 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737'} 2021-08-20 01:45:17,352 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:17,377 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:17,806 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.17582 seconds. 2021-08-20 01:45:17,820 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:17,822 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:17,909 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 185 iterations: 185 2021-08-20 01:45:17,916 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.09324 seconds. 2021-08-20 01:45:17,919 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.09942 seconds. 2021-08-20 01:45:18,335 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:45:18,371 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1} 2021-08-20 01:45:18,374 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792'} 2021-08-20 01:45:18,377 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:18,751 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.37344 seconds. 2021-08-20 01:45:18,763 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:18,765 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:18,830 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:45:18,836 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.06932 seconds. 2021-08-20 01:45:18,838 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.07429 seconds. 2021-08-20 01:45:19,116 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1} 2021-08-20 01:45:19,119 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371'} 2021-08-20 01:45:19,121 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:19,192 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:19,577 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.24281 seconds. 2021-08-20 01:45:19,594 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:45:19,598 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:45:19,683 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 200 iterations: 200 2021-08-20 01:45:19,689 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.09152 seconds. 2021-08-20 01:45:19,691 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.09825 seconds. 2021-08-20 01:45:19,965 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 5 12 and Completed 14 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:45:20,023 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:45:20,026 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112'} 2021-08-20 01:45:20,028 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:20,128 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:20,387 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.19537 seconds. 2021-08-20 01:45:20,399 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:20,401 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:20,470 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 138 iterations: 138 2021-08-20 01:45:20,479 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07554 seconds. 2021-08-20 01:45:20,483 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08242 seconds. 2021-08-20 01:45:20,884 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1} 2021-08-20 01:45:20,886 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786'} 2021-08-20 01:45:20,888 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:20,942 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:45:21,257 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.12915 seconds. 2021-08-20 01:45:21,268 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:21,271 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:21,339 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 160 iterations: 160 2021-08-20 01:45:21,347 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07439 seconds. 2021-08-20 01:45:21,351 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08142 seconds. 2021-08-20 01:45:21,770 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:21,807 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:21,810 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:45:21,812 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:45:22,301 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.41194 seconds. 2021-08-20 01:45:22,313 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:45:22,316 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:45:22,390 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:22,400 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.08310 seconds. 2021-08-20 01:45:22,404 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08986 seconds. 2021-08-20 01:45:22,721 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:22,724 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:45:22,727 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:45:22,786 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:23,176 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.40591 seconds. 2021-08-20 01:45:23,187 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:23,189 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:23,267 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:45:23,274 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08398 seconds. 2021-08-20 01:45:23,277 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08970 seconds. 2021-08-20 01:45:23,610 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:23,618 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:45:23,620 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:45:23,662 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:45:24,059 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.27359 seconds. 2021-08-20 01:45:24,070 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:24,072 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:24,141 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:24,150 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07659 seconds. 2021-08-20 01:45:24,153 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08276 seconds. 2021-08-20 01:45:24,469 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:24,471 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:45:24,474 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:45:24,527 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:24,942 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.27963 seconds. 2021-08-20 01:45:24,953 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:45:24,956 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:45:25,032 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:25,043 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.08577 seconds. 2021-08-20 01:45:25,047 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.09269 seconds. 2021-08-20 01:45:25,434 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:25,524 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:25,526 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:45:25,529 C: 18% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:45:26,026 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.49861 seconds. 2021-08-20 01:45:26,037 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:26,040 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:26,118 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:26,125 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08553 seconds. 2021-08-20 01:45:26,128 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09042 seconds. 2021-08-20 01:45:26,409 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:26,412 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:45:26,415 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:45:26,539 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:45:26,846 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.41098 seconds. 2021-08-20 01:45:26,860 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:26,862 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:26,940 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 294 iterations: 294 2021-08-20 01:45:26,948 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08593 seconds. 2021-08-20 01:45:26,951 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09169 seconds. 2021-08-20 01:45:27,349 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:45:27,406 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:27,408 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:45:27,411 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:45:27,869 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.33121 seconds. 2021-08-20 01:45:27,881 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:45:27,883 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:45:27,952 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:27,960 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07696 seconds. 2021-08-20 01:45:27,963 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08230 seconds. 2021-08-20 01:45:28,308 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:28,311 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:45:28,315 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:45:28,333 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:45:28,785 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.43622 seconds. 2021-08-20 01:45:28,796 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:45:28,799 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:45:28,871 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:28,880 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08020 seconds. 2021-08-20 01:45:28,883 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08613 seconds. 2021-08-20 01:45:29,228 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:29,230 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:45:29,232 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:45:29,250 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:45:29,706 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.37278 seconds. 2021-08-20 01:45:29,720 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:45:29,722 C: 16% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:45:29,796 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:29,804 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08127 seconds. 2021-08-20 01:45:29,807 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08713 seconds. 2021-08-20 01:45:30,041 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 4 23 and Completed 25 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:45:30,169 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:30,172 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:45:30,176 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:45:30,201 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:45:30,676 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.42467 seconds. 2021-08-20 01:45:30,694 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:45:30,699 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:45:30,778 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:30,787 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08890 seconds. 2021-08-20 01:45:30,790 C: 16% D:939.4GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09629 seconds. 2021-08-20 01:45:31,114 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:31,123 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:45:31,125 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:45:31,160 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:45:31,598 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.39576 seconds. 2021-08-20 01:45:31,610 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:45:31,613 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:45:31,686 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:45:31,694 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08096 seconds. 2021-08-20 01:45:31,696 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08651 seconds. 2021-08-20 01:45:32,031 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:45:32,033 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:45:32,036 C: 15% D:939.4GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:45:32,524 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.36389 seconds. 2021-08-20 01:45:32,535 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:45:32,537 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:45:32,610 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:32,619 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08081 seconds. 2021-08-20 01:45:32,621 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08631 seconds. 2021-08-20 01:45:32,838 C: 17% D:939.4GB M:248.9GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:45:34,873 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 136, model transformed features: 7, total model time: 2.4459, fit model time: 2.4452 2021-08-20 01:45:34,881 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 7, total model time: 3.3467, fit model time: 3.3459 2021-08-20 01:45:34,884 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 117, model transformed features: 7, total model time: 1.7569, fit model time: 1.7559 2021-08-20 01:45:34,886 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 7, total model time: 1.6383, fit model time: 1.6375 2021-08-20 01:45:34,888 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 140, model transformed features: 7, total model time: 1.7011, fit model time: 1.6997 2021-08-20 01:45:34,890 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 7, total model time: 1.6464, fit model time: 1.6455 2021-08-20 01:45:34,892 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 156, model transformed features: 6, total model time: 1.4974, fit model time: 1.4965 2021-08-20 01:45:34,894 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 185, model transformed features: 6, total model time: 1.5186, fit model time: 1.5176 2021-08-20 01:45:34,896 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 6, total model time: 1.6546, fit model time: 1.6538 2021-08-20 01:45:34,898 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 200, model transformed features: 6, total model time: 1.6126, fit model time: 1.6115 2021-08-20 01:45:34,900 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 138, model transformed features: 6, total model time: 1.51, fit model time: 1.5091 2021-08-20 01:45:34,902 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 160, model transformed features: 6, total model time: 1.4625, fit model time: 1.4616 2021-08-20 01:45:34,904 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.7533, fit model time: 1.7519 2021-08-20 01:45:34,906 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 9, total model time: 1.7385, fit model time: 1.7377 2021-08-20 01:45:34,908 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.587, fit model time: 1.5861 2021-08-20 01:45:34,910 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.6173, fit model time: 1.6162 2021-08-20 01:45:34,913 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.8235, fit model time: 1.8226 2021-08-20 01:45:34,915 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 294, model transformed features: 9, total model time: 1.7353, fit model time: 1.7344 2021-08-20 01:45:34,917 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.641, fit model time: 1.6402 2021-08-20 01:45:34,919 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.7393, fit model time: 1.7385 2021-08-20 01:45:34,921 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.675, fit model time: 1.6741 2021-08-20 01:45:34,923 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.7607, fit model time: 1.7598 2021-08-20 01:45:34,925 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 10, total model time: 1.7207, fit model time: 1.7198 2021-08-20 01:45:34,927 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.6772, fit model time: 1.6764 2021-08-20 01:45:35,516 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=2.3586 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:35,553 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=2.3461 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:35,568 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.5435 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:35,643 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.5407 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:35,669 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5421 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:35,701 C: 17% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.7544 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:36,645 C: 12% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.5817 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:36,682 C: 12% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:45:37,452 C: 12% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | Munge time: 1.1624 s, Train time: 23.7119 s, Score time: 2.4084 s 2021-08-20 01:45:37,922 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:45:38,331 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:45:38,344 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:45:38,346 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Time so far: 3408 secs 2021-08-20 01:45:38,349 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Stopping in: 82991 secs 2021-08-20 01:45:38,404 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 65.7 % 2021-08-20 01:45:38,483 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Scored 235/310 models on 30 features. Last Scored [LIGHTGBM] 2021-08-20 01:45:38,493 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:45:38,495 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.540669 +/- 0.07447481 [Tournament: 1.540669 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:45:38,498 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.542085 +/- 0.07796533 [Tournament: 1.542085 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:45:38,500 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.543484 +/- 0.07796533 [Tournament: 1.543484 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:45:38,502 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.56956 +/- 0.07548585 [Tournament: 1.56956 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:45:38,505 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.58174 +/- 0.0470579 [Tournament: 1.58174 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:45:38,507 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.754419 +/- 0.09333494 [Tournament: 1.754419 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:45:38,509 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6 : 2.346143 +/- 0.0768598 [Tournament: 2.346143 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:45:38,511 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7 : 2.358569 +/- 0.06591786 [Tournament: 2.358569 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:45:38,513 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 7 transformers creating 10 total features and 10 features for model: 1.540669 RMSE 2021-08-20 01:45:38,515 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:45:38,517 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:45:38,519 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:45:38,521 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.570066 2021-08-20 01:45:38,522 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.264919 2021-08-20 01:45:38,527 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 3 10_InteractionAdd:X_0:X_1 0.225805 2021-08-20 01:45:38,530 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.183059 2021-08-20 01:45:38,534 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 5 0_X_0 0.130161 2021-08-20 01:45:38,538 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 6 1_X_1 0.124281 2021-08-20 01:45:38,543 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.032255 2021-08-20 01:45:38,547 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 8 10_InteractionSub:X_0:X_1 0.013721 2021-08-20 01:45:38,550 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | 9 7_X_7 0.007424 2021-08-20 01:45:38,556 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment has not yet converged after 14 iteration(s). Last few scores: ['1.63852', '1.63849', '1.63849', '1.63852', '1.63852', '1.61909', '1.61909', '1.56956', '1.56956', '1.54208', '1.54208', '1.54067'] 2021-08-20 01:45:38,561 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:45:38,564 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:45:38,568 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 15 2021-08-20 01:45:38,571 C: 13% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:45:41,463 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:45:41,489 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed 114 munging tasks out of 114 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:45:41,749 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:45:41,891 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:42,059 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:42,062 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:45:42,064 C: 15% D:939.3GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:45:42,593 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 0.84202 seconds. 2021-08-20 01:45:42,611 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:45:42,615 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:45:42,693 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:42,703 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.08705 seconds. 2021-08-20 01:45:42,706 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.09512 seconds. 2021-08-20 01:45:43,051 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:43,053 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:45:43,056 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:45:43,083 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:43,535 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.64406 seconds. 2021-08-20 01:45:43,547 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:43,549 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:43,620 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:45:43,629 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07767 seconds. 2021-08-20 01:45:43,631 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08273 seconds. 2021-08-20 01:45:43,983 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:43,985 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:45:43,988 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:45:44,033 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:45:44,452 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.36834 seconds. 2021-08-20 01:45:44,469 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:44,474 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:44,560 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:44,571 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.09680 seconds. 2021-08-20 01:45:44,574 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.10563 seconds. 2021-08-20 01:45:44,887 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:44,895 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:45:44,897 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:45:44,979 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:45,353 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.37074 seconds. 2021-08-20 01:45:45,364 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:45:45,367 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:45:45,437 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:45,445 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07722 seconds. 2021-08-20 01:45:45,449 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08307 seconds. 2021-08-20 01:45:45,796 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:45,798 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:45:45,801 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:45:45,881 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:46,281 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.30399 seconds. 2021-08-20 01:45:46,292 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:46,294 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:46,367 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:46,377 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08133 seconds. 2021-08-20 01:45:46,380 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08797 seconds. 2021-08-20 01:45:46,774 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:45:46,844 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:46,846 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:45:46,849 C: 18% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:45:47,333 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.45196 seconds. 2021-08-20 01:45:47,345 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:47,347 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:47,419 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 294 iterations: 294 2021-08-20 01:45:47,427 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07935 seconds. 2021-08-20 01:45:47,429 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08432 seconds. 2021-08-20 01:45:47,808 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:47,810 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:45:47,812 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:45:47,828 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:48,293 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.51903 seconds. 2021-08-20 01:45:48,311 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:45:48,314 C: 17% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:45:48,390 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 172 iterations: 172 2021-08-20 01:45:48,398 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.08301 seconds. 2021-08-20 01:45:48,400 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08969 seconds. 2021-08-20 01:45:48,711 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:48,714 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:45:48,717 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:45:48,781 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:49,140 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.31268 seconds. 2021-08-20 01:45:49,152 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:49,154 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:49,218 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 180 iterations: 180 2021-08-20 01:45:49,227 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07137 seconds. 2021-08-20 01:45:49,231 C: 20% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.07812 seconds. 2021-08-20 01:45:49,583 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:49,594 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:45:49,596 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:45:49,617 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:45:50,050 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.26967 seconds. 2021-08-20 01:45:50,061 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:50,063 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:50,093 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 186.6GB, since last ping: 12.2kB/s. CPU memory usage: 660.1MB, max: 911.3MB CPU: 259% Procs: 5 . GPU memory usage: 8.4MB, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 17 (Disk: Read: 0B/s Write: 208.3kB/s Size: 9.3MB) (Connections: 58 Fds: 296 WinHandles: 0 Threads: 20 Maps: 4016 WinOpenFiles: 0) (System-Wide CPU: User: 11% Nice: 0% System: 6% Wait: 1% DAIActiveprocs: 2 DAIprocs: 24) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_15)_score_train-training_xgb_indiv_5_fold_4] 2021-08-20 01:45:50,132 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 184 iterations: 184 2021-08-20 01:45:50,139 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07548 seconds. 2021-08-20 01:45:50,142 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08108 seconds. 2021-08-20 01:45:50,490 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:50,493 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:45:50,497 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:45:50,514 C: 21% D:939.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:50,944 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.32592 seconds. 2021-08-20 01:45:50,956 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:45:50,958 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:45:51,032 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 229 iterations: 229 2021-08-20 01:45:51,040 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.08059 seconds. 2021-08-20 01:45:51,042 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08626 seconds. 2021-08-20 01:45:51,369 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:51,371 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:45:51,374 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:45:51,471 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:45:51,789 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.27446 seconds. 2021-08-20 01:45:51,804 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:51,807 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:51,877 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:45:51,883 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07654 seconds. 2021-08-20 01:45:51,886 C: 18% D:939.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08276 seconds. 2021-08-20 01:45:52,145 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 6 fold_id= 0 13 and Completed 15 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:45:52,221 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:52,224 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:45:52,226 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:45:52,323 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:45:52,669 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 1.19787 seconds. 2021-08-20 01:45:52,687 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:45:52,691 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:45:52,767 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 198 iterations: 198 2021-08-20 01:45:52,775 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.08437 seconds. 2021-08-20 01:45:52,778 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.09201 seconds. 2021-08-20 01:45:53,091 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:53,093 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:45:53,095 C: 16% D:939.1GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:45:53,171 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:53,555 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.23267 seconds. 2021-08-20 01:45:53,566 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:45:53,569 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:45:53,639 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:53,650 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07972 seconds. 2021-08-20 01:45:53,653 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08630 seconds. 2021-08-20 01:45:53,983 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:53,985 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:45:53,987 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:45:54,025 C: 17% D:939.1GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:54,473 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.30183 seconds. 2021-08-20 01:45:54,484 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:54,487 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:54,569 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:45:54,578 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08992 seconds. 2021-08-20 01:45:54,581 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09574 seconds. 2021-08-20 01:45:54,911 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:54,914 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:45:54,917 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:45:55,005 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:45:55,391 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.36484 seconds. 2021-08-20 01:45:55,409 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:55,412 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:55,488 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:55,497 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08481 seconds. 2021-08-20 01:45:55,500 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09234 seconds. 2021-08-20 01:45:55,821 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:55,825 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:45:55,829 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:45:55,908 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:56,337 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.33342 seconds. 2021-08-20 01:45:56,348 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:45:56,351 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:45:56,429 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:56,436 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.08498 seconds. 2021-08-20 01:45:56,438 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08992 seconds. 2021-08-20 01:45:56,789 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:45:56,800 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:56,803 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:45:56,805 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:45:57,321 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.41515 seconds. 2021-08-20 01:45:57,337 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:57,340 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:57,409 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:45:57,417 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07703 seconds. 2021-08-20 01:45:57,419 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08314 seconds. 2021-08-20 01:45:57,789 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:45:57,806 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:57,808 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:45:57,811 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:45:58,237 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.44742 seconds. 2021-08-20 01:45:58,248 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:45:58,251 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:45:58,325 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 294 iterations: 294 2021-08-20 01:45:58,334 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08249 seconds. 2021-08-20 01:45:58,337 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08891 seconds. 2021-08-20 01:45:58,728 C: 19% D:939.0GB M:248.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:45:58,811 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:58,817 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:45:58,819 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:45:59,361 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 1.57153 seconds. 2021-08-20 01:45:59,372 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:45:59,374 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:45:59,442 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 284 iterations: 284 2021-08-20 01:45:59,449 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.07482 seconds. 2021-08-20 01:45:59,451 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.07979 seconds. 2021-08-20 01:45:59,827 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:45:59,921 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:45:59,923 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:45:59,925 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:00,405 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.67654 seconds. 2021-08-20 01:46:00,421 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:00,425 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:00,502 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 247 iterations: 247 2021-08-20 01:46:00,511 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08535 seconds. 2021-08-20 01:46:00,514 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09322 seconds. 2021-08-20 01:46:00,911 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:46:01,001 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:01,004 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:46:01,008 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:01,459 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.63148 seconds. 2021-08-20 01:46:01,474 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:01,477 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:01,551 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:46:01,557 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08039 seconds. 2021-08-20 01:46:01,560 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.08653 seconds. 2021-08-20 01:46:01,859 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:01,862 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:46:01,864 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:01,930 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:46:02,358 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 1.44762 seconds. 2021-08-20 01:46:02,369 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:46:02,372 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:46:02,444 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 270 iterations: 270 2021-08-20 01:46:02,452 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.07994 seconds. 2021-08-20 01:46:02,455 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.08544 seconds. 2021-08-20 01:46:02,719 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 7 fold_id= 5 24 and Completed 26 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:46:02,750 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:02,753 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:46:02,755 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:02,875 C: 17% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:46:03,166 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.23591 seconds. 2021-08-20 01:46:03,178 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:03,180 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:03,249 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:46:03,254 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.07384 seconds. 2021-08-20 01:46:03,257 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.07911 seconds. 2021-08-20 01:46:03,581 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:03,583 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:46:03,585 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:04,026 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.15043 seconds. 2021-08-20 01:46:04,039 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:04,042 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:04,119 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 158 iterations: 158 2021-08-20 01:46:04,126 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08376 seconds. 2021-08-20 01:46:04,129 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.08990 seconds. 2021-08-20 01:46:04,310 C: 11% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:46:06,359 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.1505, fit model time: 1.1496 2021-08-20 01:46:06,365 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 9, total model time: 1.9392, fit model time: 1.9383 2021-08-20 01:46:06,367 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.7116, fit model time: 1.7107 2021-08-20 01:46:06,369 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.6863, fit model time: 1.6849 2021-08-20 01:46:06,371 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.6611, fit model time: 1.6597 2021-08-20 01:46:06,373 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 294, model transformed features: 9, total model time: 1.7833, fit model time: 1.7823 2021-08-20 01:46:06,375 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 172, model transformed features: 6, total model time: 1.8469, fit model time: 1.8458 2021-08-20 01:46:06,377 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 180, model transformed features: 6, total model time: 1.6353, fit model time: 1.6344 2021-08-20 01:46:06,378 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 184, model transformed features: 6, total model time: 1.5954, fit model time: 1.5945 2021-08-20 01:46:06,380 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 229, model transformed features: 6, total model time: 1.6817, fit model time: 1.6808 2021-08-20 01:46:06,382 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 152, model transformed features: 6, total model time: 1.561, fit model time: 1.5602 2021-08-20 01:46:06,384 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 198, model transformed features: 6, total model time: 1.569, fit model time: 1.568 2021-08-20 01:46:06,386 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.5739, fit model time: 1.5728 2021-08-20 01:46:06,388 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 9, total model time: 1.6452, fit model time: 1.6439 2021-08-20 01:46:06,390 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.6879, fit model time: 1.687 2021-08-20 01:46:06,392 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.6661, fit model time: 1.6652 2021-08-20 01:46:06,394 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 9, total model time: 1.7359, fit model time: 1.7352 2021-08-20 01:46:06,396 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 294, model transformed features: 9, total model time: 1.7641, fit model time: 1.7628 2021-08-20 01:46:06,398 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 284, model transformed features: 8, total model time: 1.9094, fit model time: 1.9084 2021-08-20 01:46:06,399 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 247, model transformed features: 8, total model time: 2.0055, fit model time: 2.0046 2021-08-20 01:46:06,401 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 150, model transformed features: 8, total model time: 1.9331, fit model time: 1.9322 2021-08-20 01:46:06,403 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 270, model transformed features: 8, total model time: 1.7701, fit model time: 1.7692 2021-08-20 01:46:06,405 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 8, total model time: 1.5397, fit model time: 1.5388 2021-08-20 01:46:06,407 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 158, model transformed features: 8, total model time: 1.4746, fit model time: 1.4738 2021-08-20 01:46:06,955 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.5414 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:07,002 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.5817 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:07,019 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.5407 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:07,072 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.5435 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:07,104 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5421 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:07,147 C: 17% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=2.0325 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:08,072 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.5414 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:08,092 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.5523 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:09,018 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Munge time: 0.0670 s, Train time: 22.8128 s, Score time: 2.3798 s 2021-08-20 01:46:09,456 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:46:09,790 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:46:09,802 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:46:09,805 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Time so far: 3439 secs 2021-08-20 01:46:09,807 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Stopping in: 82960 secs 2021-08-20 01:46:09,856 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 72.4 % 2021-08-20 01:46:09,938 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Scored 259/310 models on 30 features. Last Scored [LIGHTGBM] 2021-08-20 01:46:09,948 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:46:09,950 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.540669 +/- 0.07447481 [Tournament: 1.540669 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:46:09,952 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.541396 +/- 0.07796533 [Tournament: 1.541396 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:09,954 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.541415 +/- 0.07796533 [Tournament: 1.541415 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:09,956 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.542085 +/- 0.07796533 [Tournament: 1.542085 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:09,958 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.543484 +/- 0.07796533 [Tournament: 1.543484 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:09,960 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.552295 +/- 0.07084961 [Tournament: 1.552295 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:46:09,962 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.58174 +/- 0.0470579 [Tournament: 1.58174 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:46:09,964 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7 : 2.032518 +/- 0.05621152 [Tournament: 2.032518 Model: LIGHTGBM Feature Cost: 6] 2021-08-20 01:46:09,966 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 7 transformers creating 10 total features and 10 features for model: 1.540669 RMSE 2021-08-20 01:46:09,968 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:46:09,970 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:46:09,972 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:46:09,975 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.570066 2021-08-20 01:46:09,977 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.264919 2021-08-20 01:46:09,980 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 3 10_InteractionAdd:X_0:X_1 0.225805 2021-08-20 01:46:09,983 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.183059 2021-08-20 01:46:09,985 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 5 0_X_0 0.130161 2021-08-20 01:46:09,987 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 6 1_X_1 0.124281 2021-08-20 01:46:09,990 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.032255 2021-08-20 01:46:09,992 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 8 10_InteractionSub:X_0:X_1 0.013721 2021-08-20 01:46:09,995 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 9 7_X_7 0.007424 2021-08-20 01:46:09,998 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment has not yet converged after 15 iteration(s). Last few scores: ['1.63849', '1.63849', '1.63852', '1.63852', '1.61909', '1.61909', '1.56956', '1.56956', '1.54208', '1.54208', '1.54067', '1.54067'] 2021-08-20 01:46:10,001 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:10,004 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:46:10,006 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 16 2021-08-20 01:46:10,009 C: 14% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:46:12,403 C: 16% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:46:13,384 C: 16% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed 90 munging tasks out of 90 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:46:13,403 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1013159905', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 16) 2021-08-20 01:46:13,409 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:46:13,677 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:46:13,816 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:46:13,957 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:13,960 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:46:13,962 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:46:14,568 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 0.89039 seconds. 2021-08-20 01:46:14,582 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:46:14,585 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:46:14,656 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:14,664 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07906 seconds. 2021-08-20 01:46:14,666 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08452 seconds. 2021-08-20 01:46:14,907 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:14,909 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:46:14,911 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:46:15,027 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:46:15,373 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.55571 seconds. 2021-08-20 01:46:15,389 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:46:15,392 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:46:15,458 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 294 iterations: 294 2021-08-20 01:46:15,466 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07437 seconds. 2021-08-20 01:46:15,469 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08036 seconds. 2021-08-20 01:46:15,816 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:15,825 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:46:15,827 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:46:15,834 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:46:16,265 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.23765 seconds. 2021-08-20 01:46:16,280 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:46:16,283 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:46:16,361 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:16,370 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08659 seconds. 2021-08-20 01:46:16,373 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09365 seconds. 2021-08-20 01:46:16,714 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:16,717 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:46:16,720 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:46:16,817 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:46:17,182 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.34872 seconds. 2021-08-20 01:46:17,192 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:46:17,194 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:46:17,267 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:17,274 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07947 seconds. 2021-08-20 01:46:17,276 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08430 seconds. 2021-08-20 01:46:17,599 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:17,602 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:46:17,605 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:46:17,658 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:46:18,131 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.31569 seconds. 2021-08-20 01:46:18,148 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:46:18,152 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:46:18,232 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:18,242 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08973 seconds. 2021-08-20 01:46:18,246 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09756 seconds. 2021-08-20 01:46:18,579 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:18,582 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:46:18,584 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:46:18,628 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) start. 2021-08-20 01:46:19,011 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.35211 seconds. 2021-08-20 01:46:19,023 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:46:19,025 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:46:19,095 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:19,103 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07747 seconds. 2021-08-20 01:46:19,105 C: 19% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08249 seconds. 2021-08-20 01:46:19,409 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:46:19,416 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.56708'} 2021-08-20 01:46:19,418 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:19,436 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:46:19,729 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) end. Took 1.10168 seconds. 2021-08-20 01:46:19,740 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) start. 2021-08-20 01:46:19,742 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) start. 2021-08-20 01:46:19,807 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 62 iterations: 62 2021-08-20 01:46:19,812 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) end. Took 0.06906 seconds. 2021-08-20 01:46:19,814 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) end. Took 0.07438 seconds. 2021-08-20 01:46:20,149 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:46:20,151 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.58737'} 2021-08-20 01:46:20,154 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:20,190 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:46:20,499 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.06204 seconds. 2021-08-20 01:46:20,508 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:46:20,510 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:46:20,572 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 140 iterations: 140 2021-08-20 01:46:20,576 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.06644 seconds. 2021-08-20 01:46:20,578 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.07086 seconds. 2021-08-20 01:46:20,905 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:46:20,911 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.60792'} 2021-08-20 01:46:20,913 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:20,915 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) start. 2021-08-20 01:46:21,212 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.02129 seconds. 2021-08-20 01:46:21,222 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:46:21,224 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:46:21,290 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 59 iterations: 59 2021-08-20 01:46:21,293 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.06935 seconds. 2021-08-20 01:46:21,295 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.07342 seconds. 2021-08-20 01:46:21,656 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:46:22,023 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:46:22,026 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.60371'} 2021-08-20 01:46:22,030 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:22,349 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) end. Took 1.43367 seconds. 2021-08-20 01:46:22,362 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) start. 2021-08-20 01:46:22,365 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) start. 2021-08-20 01:46:22,445 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 57 iterations: 57 2021-08-20 01:46:22,451 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) end. Took 0.08572 seconds. 2021-08-20 01:46:22,454 C: 15% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) end. Took 0.09189 seconds. 2021-08-20 01:46:22,783 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:46:22,790 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.57112'} 2021-08-20 01:46:22,792 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:22,847 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) start. 2021-08-20 01:46:23,116 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.46071 seconds. 2021-08-20 01:46:23,127 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:46:23,130 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:46:23,195 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 159 iterations: 159 2021-08-20 01:46:23,200 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.07000 seconds. 2021-08-20 01:46:23,202 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.07487 seconds. 2021-08-20 01:46:23,555 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_3': 1} 2021-08-20 01:46:23,558 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_3': '0.58786'} 2021-08-20 01:46:23,561 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:46:23,589 C: 13% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:46:23,895 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 1) end. Took 1.04899 seconds. 2021-08-20 01:46:23,913 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) start. 2021-08-20 01:46:23,916 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) start. 2021-08-20 01:46:23,999 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:46:24,005 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 1) model predict (333, 1) end. Took 0.08921 seconds. 2021-08-20 01:46:24,008 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 2) end. Took 0.09602 seconds. 2021-08-20 01:46:24,263 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 1 14 and Completed 16 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:46:24,404 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:46:24,407 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:24,409 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:46:24,411 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:46:24,890 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 1.30012 seconds. 2021-08-20 01:46:24,901 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:46:24,909 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:46:24,979 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:24,987 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.08306 seconds. 2021-08-20 01:46:24,990 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.08861 seconds. 2021-08-20 01:46:25,334 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:25,337 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:46:25,340 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:46:25,365 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:46:25,842 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.43687 seconds. 2021-08-20 01:46:25,855 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:25,858 C: 16% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:25,940 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:25,947 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08906 seconds. 2021-08-20 01:46:25,949 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09424 seconds. 2021-08-20 01:46:26,251 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:26,253 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:46:26,255 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:46:26,329 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:46:26,703 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.33774 seconds. 2021-08-20 01:46:26,714 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:26,717 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:26,783 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:26,790 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.07313 seconds. 2021-08-20 01:46:26,792 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.07827 seconds. 2021-08-20 01:46:27,146 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:46:27,591 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:27,594 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:46:27,597 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:46:28,079 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 1.75015 seconds. 2021-08-20 01:46:28,094 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:46:28,097 C: 18% D:939.0GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:46:28,174 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:46:28,182 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.08468 seconds. 2021-08-20 01:46:28,185 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.09123 seconds. 2021-08-20 01:46:28,629 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:46:28,684 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:28,687 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:46:28,691 C: 14% D:938.9GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:46:29,174 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 2.02783 seconds. 2021-08-20 01:46:29,191 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:29,195 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:29,273 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 296 iterations: 296 2021-08-20 01:46:29,282 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08723 seconds. 2021-08-20 01:46:29,285 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09520 seconds. 2021-08-20 01:46:29,675 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) start. 2021-08-20 01:46:29,780 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:29,783 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:46:29,786 C: 15% D:938.9GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:46:30,213 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 1.58417 seconds. 2021-08-20 01:46:30,224 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:46:30,227 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:46:30,290 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:46:30,299 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.07150 seconds. 2021-08-20 01:46:30,301 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.07695 seconds. 2021-08-20 01:46:30,609 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:46:30,612 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024'} 2021-08-20 01:46:30,614 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:46:30,731 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:46:30,943 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) end. Took 1.26771 seconds. 2021-08-20 01:46:30,954 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) start. 2021-08-20 01:46:30,957 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) start. 2021-08-20 01:46:31,030 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 91 iterations: 91 2021-08-20 01:46:31,034 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) end. Took 0.07770 seconds. 2021-08-20 01:46:31,037 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) end. Took 0.08269 seconds. 2021-08-20 01:46:31,358 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:46:31,365 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019'} 2021-08-20 01:46:31,367 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:46:31,371 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:46:31,684 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.95304 seconds. 2021-08-20 01:46:31,696 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:46:31,699 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:46:31,776 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 63 iterations: 63 2021-08-20 01:46:31,781 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.08170 seconds. 2021-08-20 01:46:31,784 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.08792 seconds. 2021-08-20 01:46:32,132 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) start. 2021-08-20 01:46:32,242 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:46:32,245 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105'} 2021-08-20 01:46:32,249 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:46:32,575 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 1.20356 seconds. 2021-08-20 01:46:32,591 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:46:32,594 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:46:32,673 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 86 iterations: 86 2021-08-20 01:46:32,679 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.08439 seconds. 2021-08-20 01:46:32,682 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.09150 seconds. 2021-08-20 01:46:32,927 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:46:32,930 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946'} 2021-08-20 01:46:32,932 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:46:33,066 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:46:33,269 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) end. Took 1.13595 seconds. 2021-08-20 01:46:33,284 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) start. 2021-08-20 01:46:33,287 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) start. 2021-08-20 01:46:33,360 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 88 iterations: 88 2021-08-20 01:46:33,365 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) end. Took 0.07892 seconds. 2021-08-20 01:46:33,368 C: 17% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) end. Took 0.08498 seconds. 2021-08-20 01:46:33,708 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:46:33,716 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:46:33,718 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996'} 2021-08-20 01:46:33,720 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:46:34,036 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.96981 seconds. 2021-08-20 01:46:34,050 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:46:34,052 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:46:34,132 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 83 iterations: 83 2021-08-20 01:46:34,137 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.08459 seconds. 2021-08-20 01:46:34,139 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.09048 seconds. 2021-08-20 01:46:34,560 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:46:34,562 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150'} 2021-08-20 01:46:34,564 C: 16% D:939.0GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:46:34,900 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 1.19233 seconds. 2021-08-20 01:46:34,912 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:46:34,914 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:46:34,987 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:46:34,992 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07785 seconds. 2021-08-20 01:46:34,994 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.08299 seconds. 2021-08-20 01:46:35,166 C: 19% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:46:37,225 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.1868, fit model time: 1.1859 2021-08-20 01:46:37,233 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 294, model transformed features: 10, total model time: 1.8929, fit model time: 1.8922 2021-08-20 01:46:37,235 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.579, fit model time: 1.5779 2021-08-20 01:46:37,237 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.6782, fit model time: 1.6772 2021-08-20 01:46:37,239 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.6588, fit model time: 1.6578 2021-08-20 01:46:37,242 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.6411, fit model time: 1.6403 2021-08-20 01:46:37,244 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 62, model transformed features: 1, total model time: 1.396, fit model time: 1.3952 2021-08-20 01:46:37,246 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 140, model transformed features: 1, total model time: 1.3068, fit model time: 1.3062 2021-08-20 01:46:37,248 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 59, model transformed features: 1, total model time: 1.285, fit model time: 1.2843 2021-08-20 01:46:37,250 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 57, model transformed features: 1, total model time: 1.7281, fit model time: 1.7273 2021-08-20 01:46:37,252 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 159, model transformed features: 1, total model time: 1.7586, fit model time: 1.7572 2021-08-20 01:46:37,255 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 100, model transformed features: 1, total model time: 1.3845, fit model time: 1.3837 2021-08-20 01:46:37,257 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 8, total model time: 1.6279, fit model time: 1.6271 2021-08-20 01:46:37,259 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 8, total model time: 1.7425, fit model time: 1.7417 2021-08-20 01:46:37,261 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 8, total model time: 1.6471, fit model time: 1.6459 2021-08-20 01:46:37,263 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 8, total model time: 2.0852, fit model time: 2.0843 2021-08-20 01:46:37,265 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 296, model transformed features: 8, total model time: 2.3619, fit model time: 2.3608 2021-08-20 01:46:37,267 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 8, total model time: 1.9512, fit model time: 1.9499 2021-08-20 01:46:37,270 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 91, model transformed features: 4, total model time: 1.5507, fit model time: 1.5498 2021-08-20 01:46:37,272 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 63, model transformed features: 4, total model time: 1.2961, fit model time: 1.2953 2021-08-20 01:46:37,274 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 86, model transformed features: 4, total model time: 1.5064, fit model time: 1.5056 2021-08-20 01:46:37,276 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 88, model transformed features: 4, total model time: 1.4108, fit model time: 1.41 2021-08-20 01:46:37,278 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 83, model transformed features: 4, total model time: 1.2854, fit model time: 1.2847 2021-08-20 01:46:37,280 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 84, model transformed features: 4, total model time: 1.4832, fit model time: 1.4825 2021-08-20 01:46:37,869 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.5474 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:37,928 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.5407 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:37,958 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=4.0522 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:46:38,012 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.5572 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:38,061 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=3.9618 LIGHTGBM ['InteractionsTransformer'] 2021-08-20 01:46:38,069 C: 23% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5421 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:39,045 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.5414 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:39,055 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.5435 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:46:39,818 C: 14% D:939.0GB M:248.9GB NODE:LOCAL1 7646 INFO | Munge time: 1.0358 s, Train time: 21.7558 s, Score time: 2.4599 s 2021-08-20 01:46:40,241 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:46:40,666 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:46:40,679 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:46:40,682 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Time so far: 3470 secs 2021-08-20 01:46:40,684 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Stopping in: 82929 secs 2021-08-20 01:46:40,726 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 79.1 % 2021-08-20 01:46:40,791 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Scored 283/310 models on 31 features. Last Scored [LIGHTGBM] 2021-08-20 01:46:40,801 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:46:40,804 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.540669 +/- 0.07447481 [Tournament: 1.540669 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:46:40,806 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.541396 +/- 0.07796533 [Tournament: 1.541396 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:40,808 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.542085 +/- 0.07796533 [Tournament: 1.542085 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:40,810 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.543484 +/- 0.07796533 [Tournament: 1.543484 Model: LIGHTGBM Feature Cost: 9] 2021-08-20 01:46:40,812 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.547386 +/- 0.08567484 [Tournament: 1.547386 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:46:40,815 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.557151 +/- 0.08078833 [Tournament: 1.557151 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:46:40,817 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6 : 3.961817 +/- 0.08480774 [Tournament: 3.961817 Model: LIGHTGBM Feature Cost: 4] 2021-08-20 01:46:40,819 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7 : 4.052189 +/- 0.05662354 [Tournament: 4.052189 Model: LIGHTGBM Feature Cost: 1] 2021-08-20 01:46:40,831 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 7 transformers creating 10 total features and 10 features for model: 1.540669 RMSE 2021-08-20 01:46:40,839 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:46:40,848 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:46:40,851 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:46:40,854 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.570066 2021-08-20 01:46:40,857 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.264919 2021-08-20 01:46:40,860 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 3 10_InteractionAdd:X_0:X_1 0.225805 2021-08-20 01:46:40,863 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.183059 2021-08-20 01:46:40,866 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 5 0_X_0 0.130161 2021-08-20 01:46:40,869 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 6 1_X_1 0.124281 2021-08-20 01:46:40,872 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.032255 2021-08-20 01:46:40,875 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 8 10_InteractionSub:X_0:X_1 0.013721 2021-08-20 01:46:40,878 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 DATA | 9 7_X_7 0.007424 2021-08-20 01:46:40,882 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment has not yet converged after 16 iteration(s). Last few scores: ['1.63849', '1.63852', '1.63852', '1.61909', '1.61909', '1.56956', '1.56956', '1.54208', '1.54208', '1.54067', '1.54067', '1.54067'] 2021-08-20 01:46:40,885 C: 13% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed all expected evolution iterations: 17 2021-08-20 01:46:41,242 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Final Feature Evolution Population with population of 8 individuals (best scores=['1.547386', '1.540669', '4.052189', '1.557151', '1.542085', '3.961817', '1.541396', '1.543484']) 2021-08-20 01:46:41,249 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+----------------+-----------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-------------+-----------+--------+ 2021-08-20 01:46:41,251 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_EVOLUTION | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:46:41,252 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | |-------------+--------------+----------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+----------------+-----------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-------------+-----------+--------| 2021-08-20 01:46:41,254 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.54067 | 0.0744748 | 10.2088 | 300 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | True | EndEvolve | 1.54067 | 1.54067 | 0.0744748 | 1.54067 | 0.894742 | 1 | 13 | 100 | 10 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 1 | 1 | 112 | 0 | | + | 2021-08-20 01:46:41,256 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.5414 | 0.0779653 | 9.92547 | 299 | 9 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 6 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1] | 0 | | intermediate | True | EndEvolve | 1.5414 | 1.5414 | 0.0779653 | 1.5414 | 0.869906 | 0.996667 | 13 | 100 | 9 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.999528 | 0.999528 | 95.68 | 0.00976086 | | + | 2021-08-20 01:46:41,258 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.54208 | 0.0779653 | 10.8115 | 299 | 9 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 6 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1] | 0 | | intermediate | True | EndEvolve | 1.54208 | 1.54208 | 0.0779653 | 1.54208 | 0.947565 | 0.996667 | 13 | 100 | 9 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.999082 | 0.999082 | 95.68 | 0.0190063 | | + | 2021-08-20 01:46:41,260 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.54348 | 0.0779653 | 10.2488 | 299 | 9 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 6 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1] | 0 | | intermediate | True | EndEvolve | 1.54348 | 1.54348 | 0.0779653 | 1.54348 | 0.898248 | 0.996667 | 13 | 100 | 9 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.998176 | 0.998176 | 95.68 | 0.0377933 | | + | 2021-08-20 01:46:41,262 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.54739 | 0.0856748 | 9.6313 | 299 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | | | [1, 1, -1, 1, 0, 0, 1, 0, 1, 1] | 0 | | intermediate | True | EndEvolve | 1.54739 | 1.54739 | 0.0856748 | 1.54739 | 0.844124 | 0.996667 | 13 | 100 | 10 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.995659 | 0.995659 | 111.627 | 0.0901895 | | + | 2021-08-20 01:46:41,264 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.55715 | 0.0807883 | 11.4098 | 300 | 8 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 5 | 100 | True | | | [1, 1, -1, 1, 0, 0, 1, 1] | 0 | | intermediate | True | EndEvolve | 1.55715 | 1.55715 | 0.0807883 | 1.55715 | 1 | 1 | 13 | 100 | 8 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.989416 | 0.989416 | 80 | 0.221298 | | + | 2021-08-20 01:46:41,265 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 3.96182 | 0.0848077 | 8.52773 | 83 | 4 | ['InteractionsTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 1 | 100 | True | | | [1, -1, 1, 0] | 0 | | intermediate | True | EndEvolve | 3.96182 | 3.96182 | 0.0848077 | 3.96182 | 0.747403 | 0.276667 | 13 | 100 | 4 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.38888 | 0.38888 | 4.42667 | 32.5096 | | + | 2021-08-20 01:46:41,267 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 4.05219 | 0.0566235 | 8.85385 | 97 | 1 | ['OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.5 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 1 | 100 | True | | | [1] | 0 | | intermediate | True | EndEvolve | 4.05219 | 4.05219 | 0.0566235 | 4.05219 | 0.775985 | 0.323333 | 13 | 100 | 1 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.380207 | 0.380207 | 5.17333 | 33.7231 | | + | 2021-08-20 01:46:41,269 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+----------------+-----------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-------------+-----------+--------+ 2021-08-20 01:46:41,340 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,344 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,349 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,355 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,360 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,366 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,372 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,376 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7 (best: 1) for final model is not derived from H2O.ai brain cache 2021-08-20 01:46:41,381 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting feature importances and descriptions to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/features.txt 2021-08-20 01:46:41,384 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting original feature importances and descriptions for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/features_orig.txt 2021-08-20 01:46:41,606 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 0 layer 0 2021-08-20 01:46:42,029 C: 15% D:939.0GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 1 layer 0 2021-08-20 01:46:42,496 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 2 layer 0 2021-08-20 01:46:42,915 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 3 layer 0 2021-08-20 01:46:43,416 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 4 layer 0 2021-08-20 01:46:43,816 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 5 layer 0 2021-08-20 01:46:44,279 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 6 layer 0 2021-08-20 01:46:44,737 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to final individual 7 layer 0 2021-08-20 01:46:45,099 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:46:45,544 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:46:45,558 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final population size before sampling: 8. After sampling expected population size: 1. 2021-08-20 01:46:45,572 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final population size after sampling: 1 (0 reference) with models_final=3 and num_ensemble_folds=3 2021-08-20 01:46:45,728 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final Model sampled population with population of 8 individuals (best scores=['1.540669']) 2021-08-20 01:46:45,731 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+----------------+-------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:46:45,734 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_EVOLUTION | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:46:45,736 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | |-------------+--------------+----------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+----------------+-------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------| 2021-08-20 01:46:45,738 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.54067 | 0.0744748 | 10.2088 | 300 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | True | SampleFinal | 1.54067 | 1.54067 | 0.0744748 | 1.54067 | 1 | 1 | 13 | 100 | 10 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 1 | 1 | 112 | 0 | | | 2021-08-20 01:46:45,741 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+----------------+-------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:46:45,755 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Exporting best unfitted pipeline to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/unfitted_pipeline.pickle 2021-08-20 01:46:45,791 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Deleting temporary files from tuning and evolution before building final pipeline 2021-08-20 01:46:45,804 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Checking Pipeline for types of features and if can make mojo 2021-08-20 01:46:45,855 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Pipeline can create MOJO 2021-08-20 01:46:45,860 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Pipeline is reproducible 2021-08-20 01:46:45,864 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final Boosters: ['lightgbm'] and Models ['LIGHTGBM'] 2021-08-20 01:46:45,868 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final Models can create MOJO 2021-08-20 01:46:45,875 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final Models are reproducible 2021-08-20 01:46:45,956 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Transformations possible for any experiment: [BERT, CVCatNumEncode, CVTECUML, CVTargetEncode, CatOriginal, Cat, ClusterDistCUMLDask, ClusterDistCUML, ClusterDist, ClusterIdAllNum, ClusterTE, DBSCANCUMLDask, DBSCANCUML, DateOriginal, DateTimeDiff, DateTimeOriginal, Dates, EwmaLags, Frequent, ImageOriginal, ImageVectorizer, Interactions, IsHoliday, IsolationForestAnomalyAllNumeric, IsolationForestAnomalyNumCatAllCols, IsolationForestAnomalyNumCat, IsolationForestAnomalyNumeric, LagsAggregates, LagsInteraction, Lags, LexiLabelEncoder, MeanTarget, NumCatTE, NumToCatTE, NumToCatWoEMonotonic, NumToCatWoE, OneHotEncoding, OrigFreqPre, OrigOHEPre, OrigPre, Original, Raw, StandardScaler, StdFreqPre, StringConcat, TSNECUML, TextBiGRU, TextCNN, TextCharCNN, TextLinModel, TextOriginal, Text, TruncSVDAllNum, TruncSVDCUMLDask, TruncSVDCUML, TruncSVDNum, UMAPCUMLDask, UMAPCUML, WeightOfEvidence] 2021-08-20 01:46:45,958 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Transformations allowed for this experiment: [BERT, CVCatNumEncode, CVTECUML, CVTargetEncode, CatOriginal, Cat, ClusterDistCUMLDask, ClusterDistCUML, ClusterDist, ClusterIdAllNum, ClusterTE, DBSCANCUMLDask, DBSCANCUML, DateOriginal, DateTimeDiff, DateTimeOriginal, Dates, EwmaLags, Frequent, ImageOriginal, ImageVectorizer, Interactions, IsHoliday, IsolationForestAnomalyAllNumeric, IsolationForestAnomalyNumCatAllCols, IsolationForestAnomalyNumCat, IsolationForestAnomalyNumeric, LagsAggregates, LagsInteraction, Lags, LexiLabelEncoder, MeanTarget, NumCatTE, NumToCatTE, NumToCatWoEMonotonic, NumToCatWoE, OneHotEncoding, OrigFreqPre, OrigOHEPre, OrigPre, Original, Raw, StandardScaler, StdFreqPre, StringConcat, TSNECUML, TextBiGRU, TextCNN, TextCharCNN, TextLinModel, TextOriginal, Text, TruncSVDAllNum, TruncSVDCUMLDask, TruncSVDCUML, TruncSVDNum, UMAPCUMLDask, UMAPCUML, WeightOfEvidence] 2021-08-20 01:46:45,961 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Custom transformations possible for any experiment: [] 2021-08-20 01:46:45,964 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Custom transformations allowed for this experiment: [] 2021-08-20 01:46:45,966 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Final Ensembled Individual 0: Layer: 0: RMSE=1.5407 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] model_origin=RANDOM original job_order=6 2021-08-20 01:46:45,975 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Training final scoring pipeline... 2021-08-20 01:46:45,980 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Base model 0 for ensemble is LIGHTGBM model with do_te: True, num_as_cat: True, interpretability: 8 2021-08-20 01:46:46,000 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Performing Stacked Ensemble fit_transform for final ensemble. 2021-08-20 01:46:46,003 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Ensemble model 0 [LIGHTGBM] doesn't support blending in link space 2021-08-20 01:46:46,005 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Ensemble holdout preds: blending in target space 2021-08-20 01:46:46,010 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Training 3 base learners for stacked ensemble of types: ['LIGHTGBM'] 2021-08-20 01:46:46,089 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Experiment Progress: 79.1 % 2021-08-20 01:46:46,094 C: 12% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Training 3 final models [LIGHTGBM]. 2021-08-20 01:46:46,112 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Pipeline fit_transform (666, 6) start. 2021-08-20 01:46:46,128 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Using 1 parallel workers (2 parent workers) for fit_transform. 2021-08-20 01:46:46,155 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 79.1 % 2021-08-20 01:46:46,160 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Training 3 final models [LIGHTGBM]. 2021-08-20 01:46:46,220 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Pipeline fit_transform (667, 6) start. 2021-08-20 01:46:46,232 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Using 1 parallel workers (2 parent workers) for fit_transform. 2021-08-20 01:46:46,396 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:46,403 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Pipeline fit_transform (666, 6) end. Took 0.29096 seconds. 2021-08-20 01:46:46,405 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] pipeline transform (334, 6) start. 2021-08-20 01:46:46,449 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:46,456 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Pipeline fit_transform (667, 6) end. Took 0.23450 seconds. 2021-08-20 01:46:46,458 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] pipeline transform (333, 6) start. 2021-08-20 01:46:46,587 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:46,593 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] pipeline transform (334, 6) end. Took 0.18571 seconds. 2021-08-20 01:46:46,597 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:46:46,644 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:46,649 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] pipeline transform (333, 6) end. Took 0.18980 seconds. 2021-08-20 01:46:46,654 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:46:46,947 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:46,950 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:46:46,952 C: 11% D:938.9GB M:249.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:46:47,845 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.24412 seconds. 2021-08-20 01:46:47,855 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict (334, 10) start. 2021-08-20 01:46:48,101 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:46:48,122 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:48,125 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:46:48,128 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:46:48,222 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict (334, 10) end. Took 0.36777 seconds. 2021-08-20 01:46:48,706 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Experiment Progress: 80.5 % 2021-08-20 01:46:48,710 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Trained 1 of 3 final models [LIGHTGBM]. 2021-08-20 01:46:48,714 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Completed LightGBMModel Iterations: 500 Total Time: 2.4 (s) Predict Time: 0.38 (s) Pipe Time: 0.49 (s) Pipe Fit Time: 0.3 (s) Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 100, 'n_estimators': 500, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 7, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': 0, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_FINAL': True, 'task': None} 2021-08-20 01:46:48,716 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Completed LightGBMModel Iterations: 500 Total Time: 2.4 (s) Predict Time: 0.38 (s) Pipe Time: 0.49 (s) Pipe Fit Time: 0.3 (s) 2021-08-20 01:46:48,733 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Pipeline fit_transform (667, 6) start. 2021-08-20 01:46:48,745 C: 18% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Using 1 parallel workers (2 parent workers) for fit_transform. 2021-08-20 01:46:48,850 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.19318 seconds. 2021-08-20 01:46:48,860 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict (333, 10) start. 2021-08-20 01:46:48,951 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:48,958 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Pipeline fit_transform (667, 6) end. Took 0.22486 seconds. 2021-08-20 01:46:48,961 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] pipeline transform (333, 6) start. 2021-08-20 01:46:49,080 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:46:49,140 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:49,147 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] pipeline transform (333, 6) end. Took 0.18343 seconds. 2021-08-20 01:46:49,152 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:46:49,197 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict (333, 10) end. Took 0.34056 seconds. 2021-08-20 01:46:49,470 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:46:49,472 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:46:49,474 C: 17% D:938.9GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:46:50,205 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.05167 seconds. 2021-08-20 01:46:50,215 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict (333, 10) start. 2021-08-20 01:46:50,452 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:46:50,591 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict (333, 10) end. Took 0.37613 seconds. 2021-08-20 01:46:51,011 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 83.3 % 2021-08-20 01:46:51,015 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed 3/3 final ensemble models. 2021-08-20 01:46:51,030 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Model performance: 2021-08-20 01:46:51,032 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | fold: 0, model name: LightGBM, model iterations: 500, model transformed features: 10, total model time: 2.4198, fit+predict model time: 0.376, total pipeline time: 0.48786, fit pipeline time: 0.29738 2021-08-20 01:46:51,034 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | fold: 1, model name: LightGBM, model iterations: 500, model transformed features: 10, total model time: 3.343, fit+predict model time: 0.34681, total pipeline time: 0.43664, fit pipeline time: 0.24267 2021-08-20 01:46:51,037 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | fold: 2, model name: LightGBM, model iterations: 473, model transformed features: 10, total model time: 2.1446, fit+predict model time: 0.38534, total pipeline time: 0.41979, fit pipeline time: 0.23152 2021-08-20 01:46:51,039 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| Final model LightGBMModel model_id 0 fold_id 0 hit maximum trees/iterations of 500 2021-08-20 01:46:51,041 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| Final model LightGBMModel model_id 0 fold_id 1 hit maximum trees/iterations of 500 2021-08-20 01:46:51,044 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| Consider using toml or expert model options to increase the minimum learning rate or increase the maximum number of trees/iterations. 2021-08-20 01:46:51,046 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Computing ensemble-averaged variable importance. 2021-08-20 01:46:51,048 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Processing ensemble holdout predictions. 2021-08-20 01:46:51,115 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing ensemble base learner fold scores artifacts. 2021-08-20 01:46:51,124 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Ensemble Base Model Fold Scores 2021-08-20 01:46:51,128 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | +---------+---------------+-----------+------------+---------+---------+----------+----------+----------+---------+---------+----------+---------+----------+---------+ 2021-08-20 01:46:51,133 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | index | model_name | fold_id | model_id | SMAPE | RMSPE | RMSLE | R2COD | R2 | MSE | MER | MAPE | MAE | GINI | RMSE | 2021-08-20 01:46:51,137 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | |---------+---------------+-----------+------------+---------+---------+----------+----------+----------+---------+---------+----------+---------+----------+---------| 2021-08-20 01:46:51,141 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | 0 | LightGBMModel | 0 | 0 | 9.63089 | 23.1705 | 0.131184 | 0.900864 | 0.901531 | 2.53063 | 6.13003 | 10.8374 | 1.15218 | 0.950988 | 1.5908 | 2021-08-20 01:46:51,144 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | 1 | LightGBMModel | 1 | 0 | 9.19146 | 14.5717 | 0.118526 | 0.903606 | 0.903681 | 2.42452 | 7.07733 | 9.50272 | 1.18065 | 0.954402 | 1.55709 | 2021-08-20 01:46:51,148 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | 2 | LightGBMModel | 2 | 0 | 9.16105 | 21.4284 | 1e+36 | 0.909753 | 0.909875 | 2.20147 | 6.30881 | 9.83987 | 1.11207 | 0.953189 | 1.48374 | 2021-08-20 01:46:51,152 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | +---------+---------------+-----------+------------+---------+---------+----------+----------+----------+---------+---------+----------+---------+----------+---------+ 2021-08-20 01:46:51,161 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Training ensemble meta learner [LinearBlender without CV]... 2021-08-20 01:46:51,165 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Ensemble meta learner: blending in target space 2021-08-20 01:46:51,169 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Ensemble meta learner: no validation data, no early stopping 2021-08-20 01:46:51,173 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | LinearBlender: meta learner using n_jobs=10 2021-08-20 01:46:51,178 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | LinearBlender: optimal weights = [1.000] (arithmetic_mean) 2021-08-20 01:46:51,183 C: 17% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Final metalearner weights = [1.0] 2021-08-20 01:46:51,903 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Finished training ensemble meta learner. 2021-08-20 01:46:51,910 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Stacked Ensemble: Exporting fitted model to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle 2021-08-20 01:46:51,913 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting fitted model meta info to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle.meta.json 2021-08-20 01:46:51,915 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting fitted model importance tables and other model information to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle.info.pickle 2021-08-20 01:46:51,922 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting fitted model descriptions info to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle.meta.descdict.json 2021-08-20 01:46:51,926 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Fitted Models and Pipelines can make mojo 2021-08-20 01:46:51,929 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Fitted Models and Pipelines are reproducible 2021-08-20 01:46:51,933 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | common model.params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'pred_gap': None, 'pred_periods': None, 'ufapt': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05000000000000001, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 100, 'n_estimators': 500, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 7, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': 0, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_FINAL': True, 'task': None} 2021-08-20 01:46:51,936 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | common model.params: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'pred_gap': None, 'pred_periods': None, 'ufapt': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05000000000000001, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 100, 'n_estimators': 500, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 7, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': 0, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_FINAL': True, 'task': None} 2021-08-20 01:46:52,979 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Checking for shift in tuning model -> final model variable importances 2021-08-20 01:46:52,994 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 DATA | New features created only in final pipeline: Count: 0 List: [] 2021-08-20 01:46:52,996 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 DATA | Extra features created in final pipeline compared to genetic algorithm population: Count: 0 List: [] 2021-08-20 01:46:52,999 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 DATA | Missing features from final StackedEnsemble pipeline compared to genetic algorithm population: Count: 0 List: [] 2021-08-20 01:46:53,001 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Completed training of the final scoring pipeline 2021-08-20 01:46:53,004 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Predictions and Scoring final pipeline... 2021-08-20 01:46:53,007 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Bootstrap sampling seed 1037348886 2021-08-20 01:46:53,015 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [CONSTANT] model fit (1000, 6) start. 2021-08-20 01:46:53,071 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [CONSTANT] model fit (1000, 6) end. Took 0.05607 seconds. 2021-08-20 01:46:53,085 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [CONSTANT] model predict_with_transform (1000, 6) start. 2021-08-20 01:46:53,088 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [CONSTANT] (1000, 6) model predict (1000, 6) start. 2021-08-20 01:46:53,091 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [CONSTANT] (1000, 6) model predict (1000, 6) end. Took 0.00308 seconds. 2021-08-20 01:46:53,094 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [CONSTANT] model predict_with_transform (1000, 6) end. Took 0.00848 seconds. 2021-08-20 01:46:53,097 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Constant Model: RMSE = 5.002508 with predictions = ['14.35'] 2021-08-20 01:46:53,111 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Prediction Intervals (global) for 90% confidence level: 2021-08-20 01:46:53,113 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | lower bound upper bound 2021-08-20 01:46:53,116 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | float64 float64 2021-08-20 01:46:53,118 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | -- + ----------- ----------- 2021-08-20 01:46:53,120 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 0 | -2.39481 2.3113 2021-08-20 01:46:53,123 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [1 row x 2 columns] 2021-08-20 01:46:53,126 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:53,368 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1, 6) start. 2021-08-20 01:46:53,602 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:53,608 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1, 10) model predict Shapley (1, 10) start. 2021-08-20 01:46:53,738 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:46:53,790 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1, 10) model predict Shapley (1, 10) end. Took 0.18297 seconds. 2021-08-20 01:46:53,792 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1, 6) end. Took 0.43033 seconds. 2021-08-20 01:46:53,951 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1, 6) start. 2021-08-20 01:46:54,205 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:54,212 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1, 10) model predict Shapley (1, 10) start. 2021-08-20 01:46:54,346 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:46:54,397 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1, 10) model predict Shapley (1, 10) end. Took 0.18559 seconds. 2021-08-20 01:46:54,400 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1, 6) end. Took 0.45145 seconds. 2021-08-20 01:46:54,559 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1, 6) start. 2021-08-20 01:46:54,853 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:46:54,862 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1, 10) model predict Shapley (1, 10) start. 2021-08-20 01:46:55,008 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:46:55,034 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1, 10) model predict Shapley (1, 10) end. Took 0.17543 seconds. 2021-08-20 01:46:55,036 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1, 6) end. Took 0.47998 seconds. 2021-08-20 01:46:55,135 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Begin Pipeline Info for Ensemble Base (Num. 0) Model LightGBMModel with size: 339574 2021-08-20 01:46:55,145 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline sizes for top 7 features, sorted by size (largest first) 2021-08-20 01:46:55,148 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | ['gene prefix', 'model index', 'size in bytes', 'transformer name', 'num. inputs', 'rel. importance'] 2021-08-20 01:46:55,150 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [10, 0, 1836, 'InteractionsTransformer', 2, 1.0] 2021-08-20 01:46:55,153 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [0, 0, 1083, 'OriginalTransformer', 1, 0.16388418] 2021-08-20 01:46:55,155 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [1, 0, 1083, 'OriginalTransformer', 1, 0.16404164] 2021-08-20 01:46:55,157 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [2, 0, 1083, 'OriginalTransformer', 1, 0.20791236] 2021-08-20 01:46:55,160 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [3, 0, 1083, 'OriginalTransformer', 1, 0.9472579] 2021-08-20 01:46:55,162 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [4, 0, 1083, 'OriginalTransformer', 1, 0.26275748] 2021-08-20 01:46:55,164 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [7, 0, 1083, 'OriginalTransformer', 1, 0.009509118] 2021-08-20 01:46:55,167 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline count: 7 2021-08-20 01:46:55,169 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline max bytes: 1836 2021-08-20 01:46:55,172 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline sum bytes: 8334 2021-08-20 01:46:55,174 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Number of duplicates: 0 2021-08-20 01:46:55,176 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | End Pipeline Info 2021-08-20 01:46:55,179 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Begin Pipeline Info for Ensemble Base (Num. 1) Model LightGBMModel with size: 334452 2021-08-20 01:46:55,182 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline sizes for top 7 features, sorted by size (largest first) 2021-08-20 01:46:55,185 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | ['gene prefix', 'model index', 'size in bytes', 'transformer name', 'num. inputs', 'rel. importance'] 2021-08-20 01:46:55,188 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [10, 1, 1836, 'InteractionsTransformer', 2, 1.0] 2021-08-20 01:46:55,190 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [0, 1, 1083, 'OriginalTransformer', 1, 0.14217724] 2021-08-20 01:46:55,193 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [1, 1, 1083, 'OriginalTransformer', 1, 0.15632607] 2021-08-20 01:46:55,195 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [2, 1, 1083, 'OriginalTransformer', 1, 0.2031572] 2021-08-20 01:46:55,198 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [3, 1, 1083, 'OriginalTransformer', 1, 0.9594361] 2021-08-20 01:46:55,200 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [4, 1, 1083, 'OriginalTransformer', 1, 0.27870998] 2021-08-20 01:46:55,202 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [7, 1, 1083, 'OriginalTransformer', 1, 0.016395662] 2021-08-20 01:46:55,205 C: 36% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline count: 7 2021-08-20 01:46:55,213 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline max bytes: 1836 2021-08-20 01:46:55,215 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline sum bytes: 8334 2021-08-20 01:46:55,217 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Number of duplicates: 0 2021-08-20 01:46:55,220 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | End Pipeline Info 2021-08-20 01:46:55,222 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Begin Pipeline Info for Ensemble Base (Num. 2) Model LightGBMModel with size: 326045 2021-08-20 01:46:55,225 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline sizes for top 7 features, sorted by size (largest first) 2021-08-20 01:46:55,229 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | ['gene prefix', 'model index', 'size in bytes', 'transformer name', 'num. inputs', 'rel. importance'] 2021-08-20 01:46:55,232 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [10, 2, 1836, 'InteractionsTransformer', 2, 0.8498894] 2021-08-20 01:46:55,234 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [0, 2, 1083, 'OriginalTransformer', 1, 0.13019776] 2021-08-20 01:46:55,237 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [1, 2, 1083, 'OriginalTransformer', 1, 0.12423109] 2021-08-20 01:46:55,239 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [2, 2, 1083, 'OriginalTransformer', 1, 0.18493544] 2021-08-20 01:46:55,241 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [3, 2, 1083, 'OriginalTransformer', 1, 1.0] 2021-08-20 01:46:55,243 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [4, 2, 1083, 'OriginalTransformer', 1, 0.28759658] 2021-08-20 01:46:55,245 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | [7, 2, 1083, 'OriginalTransformer', 1, 0.011053125] 2021-08-20 01:46:55,247 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline count: 7 2021-08-20 01:46:55,249 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline max bytes: 1836 2021-08-20 01:46:55,251 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Pipeline sum bytes: 8334 2021-08-20 01:46:55,253 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Number of duplicates: 0 2021-08-20 01:46:55,255 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | End Pipeline Info 2021-08-20 01:46:55,309 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Size of fitted python (/opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle): 296.0kB written in 0.05546689 seconds (with validation) 2021-08-20 01:46:55,312 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Saved fitted model to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle 2021-08-20 01:46:55,700 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing csv train set (holdout) predictions to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/train_preds.csv 2021-08-20 01:46:55,712 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 187.1GB, since last ping: 227.5kB/s. CPU memory usage: 526.7MB, max: 911.3MB CPU: 99% Procs: 3 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/3145728 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 185B/s Write: 670.5kB/s Size: 8.6MB) (Connections: 46 Fds: 212 WinHandles: 0 Threads: 12 Maps: 3193 WinOpenFiles: 0) (System-Wide CPU: User: 8% Nice: 0% System: 3% Wait: 1% DAIActiveprocs: 2 DAIprocs: 23) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:final_modelmake_final_scoring_pipelinemakereg1-3-make_holdout_preds_2] 2021-08-20 01:46:55,723 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing binary holdout train set (holdout) predictions to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/train_preds.bin 2021-08-20 01:46:55,750 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSE Fold#0]... 2021-08-20 01:46:55,785 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [GINI Fold#0]... 2021-08-20 01:46:55,827 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MAE Fold#0]... 2021-08-20 01:46:55,873 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MAPE Fold#0]... 2021-08-20 01:46:55,889 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MER Fold#0]... 2021-08-20 01:46:55,907 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MSE Fold#0]... 2021-08-20 01:46:55,941 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [R2 Fold#0]... 2021-08-20 01:46:55,969 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [R2COD Fold#0]... 2021-08-20 01:46:56,014 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSLE Fold#0]... 2021-08-20 01:46:56,071 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSPE Fold#0]... 2021-08-20 01:46:56,086 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [SMAPE Fold#0]... 2021-08-20 01:46:56,100 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSE Fold#1]... 2021-08-20 01:46:56,138 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [GINI Fold#1]... 2021-08-20 01:46:56,175 C: 23% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MAE Fold#1]... 2021-08-20 01:46:56,218 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MAPE Fold#1]... 2021-08-20 01:46:56,239 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MER Fold#1]... 2021-08-20 01:46:56,264 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MSE Fold#1]... 2021-08-20 01:46:56,305 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [R2 Fold#1]... 2021-08-20 01:46:56,329 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [R2COD Fold#1]... 2021-08-20 01:46:56,362 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSLE Fold#1]... 2021-08-20 01:46:56,411 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSPE Fold#1]... 2021-08-20 01:46:56,428 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [SMAPE Fold#1]... 2021-08-20 01:46:56,450 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSE Fold#2]... 2021-08-20 01:46:56,497 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [GINI Fold#2]... 2021-08-20 01:46:56,537 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MAE Fold#2]... 2021-08-20 01:46:56,568 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MAPE Fold#2]... 2021-08-20 01:46:56,581 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MER Fold#2]... 2021-08-20 01:46:56,597 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [MSE Fold#2]... 2021-08-20 01:46:56,628 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [R2 Fold#2]... 2021-08-20 01:46:56,650 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [R2COD Fold#2]... 2021-08-20 01:46:56,702 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSLE Fold#2]... 2021-08-20 01:46:56,729 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [RMSPE Fold#2]... 2021-08-20 01:46:56,751 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Scoring final pipeline [SMAPE Fold#2]... 2021-08-20 01:46:56,776 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSE valid_oof_score=1.54457 valid score=1.54387 fold_sd=0.0446946 bootstrap_sd=7.94729e-08 sd=0.0446946 2021-08-20 01:46:56,780 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | GINI valid_oof_score=0.952609 valid score=0.95286 fold_sd=0.00141313 bootstrap_sd=3.70074e-17 sd=0.00141313 2021-08-20 01:46:56,785 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAE valid_oof_score=1.1483 valid score=1.1483 fold_sd=0.0281301 bootstrap_sd=7.94729e-08 sd=0.0281301 2021-08-20 01:46:56,789 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAPE valid_oof_score=10.0608 valid score=10.06 fold_sd=0.566676 bootstrap_sd=0 sd=0.566676 2021-08-20 01:46:56,792 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MER valid_oof_score=6.53739 valid score=6.50539 fold_sd=0.410959 bootstrap_sd=0 sd=0.410959 2021-08-20 01:46:56,796 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MSE valid_oof_score=2.38568 valid score=2.38554 fold_sd=0.137176 bootstrap_sd=0 sd=0.137176 2021-08-20 01:46:56,800 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2 valid_oof_score=0.904693 valid score=0.905029 fold_sd=0.00353755 bootstrap_sd=1.11022e-16 sd=0.00353755 2021-08-20 01:46:56,804 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2COD valid_oof_score=0.904668 valid score=0.904741 fold_sd=0.00371669 bootstrap_sd=3.70074e-17 sd=0.00371669 2021-08-20 01:46:56,808 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSLE valid_oof_score=1e+36 valid score=3.33333e+35 fold_sd=4.71405e+35 bootstrap_sd=4.91913e+19 sd=4.71405e+35 2021-08-20 01:46:56,812 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSPE valid_oof_score=20.0731 valid score=19.7235 fold_sd=3.71167 bootstrap_sd=1.77636e-15 sd=3.71167 2021-08-20 01:46:56,815 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | SMAPE valid_oof_score=9.3281 valid score=9.3278 fold_sd=0.214677 bootstrap_sd=0 sd=0.214677 2021-08-20 01:46:57,177 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| Instability of cross-validation fold scores detected: 2021-08-20 01:46:57,180 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| +----+---------------+-----------+------------+----------+ 2021-08-20 01:46:57,183 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| | | model_name | fold_id | model_id | RMSLE | 2021-08-20 01:46:57,185 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| |----+---------------+-----------+------------+----------| 2021-08-20 01:46:57,187 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| | 0 | LightGBMModel | 0 | 0 | 0.131184 | 2021-08-20 01:46:57,190 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| | 1 | LightGBMModel | 1 | 0 | 0.118526 | 2021-08-20 01:46:57,192 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| | 2 | LightGBMModel | 2 | 0 | 1e+36 | 2021-08-20 01:46:57,195 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 WARNING| +----+---------------+-----------+------------+----------+ 2021-08-20 01:46:57,198 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Validation scores (internal holdout, bootstrap on folds) +/- stddev across folds: 2021-08-20 01:46:57,201 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSE GINI \ 2021-08-20 01:46:57,203 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 0 1.590796 +/- 1.192093e-07 0.950988 +/- 1.110223e-16 2021-08-20 01:46:57,206 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 1 1.557085 +/- 1.192093e-07 0.9544022 +/- 0 2021-08-20 01:46:57,208 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2 1.483736 +/- 0 0.9531888 +/- 0 2021-08-20 01:46:57,210 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:57,213 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAE MAPE MER MSE \ 2021-08-20 01:46:57,215 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 0 1.152181 +/- 1.192093e-07 10.8374 +/- 0 6.130025 +/- 0 2.53063 +/- 0 2021-08-20 01:46:57,217 C: 13% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 1 1.180646 +/- 0 9.502723 +/- 0 7.077334 +/- 0 2.424515 +/- 0 2021-08-20 01:46:57,226 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2 1.112071 +/- 1.192093e-07 9.839868 +/- 0 6.30881 +/- 0 2.201471 +/- 0 2021-08-20 01:46:57,228 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:57,230 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2 R2COD \ 2021-08-20 01:46:57,232 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 0 0.9015308 +/- 1.110223e-16 0.9008638 +/- 1.110223e-16 2021-08-20 01:46:57,234 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 1 0.903681 +/- 1.110223e-16 0.9036063 +/- 0 2021-08-20 01:46:57,236 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2 0.9098755 +/- 1.110223e-16 0.9097531 +/- 0 2021-08-20 01:46:57,239 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:57,241 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSLE RMSPE SMAPE 2021-08-20 01:46:57,243 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 0 0.131184 +/- 0 23.17051 +/- 0 9.63089 +/- 0 2021-08-20 01:46:57,245 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 1 0.1185262 +/- 1.490116e-08 14.57171 +/- 1.776357e-15 9.191461 +/- 0 2021-08-20 01:46:57,247 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2 1e+36 +/- 1.47574e+20 21.42841 +/- 3.552714e-15 9.161048 +/- 0 2021-08-20 01:46:57,250 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================================= 2021-08-20 01:46:57,252 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:57,254 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Final validation scores (internal holdout, on out-of-fold predictions): 2021-08-20 01:46:57,256 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | optimized: RMSE = 1.544566 (less is better) 2021-08-20 01:46:57,258 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | GINI = 0.9526091 (more is better) 2021-08-20 01:46:57,260 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAE = 1.148303 (less is better) 2021-08-20 01:46:57,263 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAPE = 10.06077 (less is better) 2021-08-20 01:46:57,265 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MER = 6.537393 (less is better) 2021-08-20 01:46:57,267 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MSE = 2.385684 (less is better) 2021-08-20 01:46:57,269 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2 = 0.9046932 (more is better) 2021-08-20 01:46:57,271 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2COD = 0.9046683 (more is better) 2021-08-20 01:46:57,274 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSLE = 1e+36 (less is better) 2021-08-20 01:46:57,276 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSPE = 20.07309 (less is better) 2021-08-20 01:46:57,278 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | SMAPE = 9.328103 (less is better) 2021-08-20 01:46:57,280 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================================= 2021-08-20 01:46:57,282 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:46:57,284 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Final validation scores (internal holdout, bootstrap on folds) +/- stddev: 2021-08-20 01:46:57,287 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | optimized: RMSE = 1.543872 +/- 0.04469455 (less is better) 2021-08-20 01:46:57,289 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | GINI = 0.9528597 +/- 0.001413133 (more is better) 2021-08-20 01:46:57,291 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAE = 1.148299 +/- 0.02813014 (less is better) 2021-08-20 01:46:57,293 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MAPE = 10.06 +/- 0.5666763 (less is better) 2021-08-20 01:46:57,295 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MER = 6.50539 +/- 0.4109592 (less is better) 2021-08-20 01:46:57,298 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | MSE = 2.385539 +/- 0.1371758 (less is better) 2021-08-20 01:46:57,300 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2 = 0.9050291 +/- 0.00353755 (more is better) 2021-08-20 01:46:57,302 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | R2COD = 0.9047411 +/- 0.00371669 (more is better) 2021-08-20 01:46:57,304 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSLE = 3.333333e+35 +/- 4.714045e+35 (less is better) 2021-08-20 01:46:57,306 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | RMSPE = 19.72355 +/- 3.711674 (less is better) 2021-08-20 01:46:57,308 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | SMAPE = 9.3278 +/- 0.2146766 (less is better) 2021-08-20 01:46:57,311 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | ============================================================================================= 2021-08-20 01:46:57,313 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Outputting final individual_scored info. 2021-08-20 01:46:57,896 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Final Model 2021-08-20 01:46:57,898 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | +-------------+--------------+--------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+------------+--------+---------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:46:57,901 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_FINAL | task | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:46:57,903 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | |-------------+--------------+--------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+------------+--------+---------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------| 2021-08-20 01:46:57,905 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | FINAL BASE MODEL 0 | LightGBMModel | 1.54387 | 0.0446946 | 10.2088 | 300 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 100 | 500 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | 0 | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | True | | Final | 1.54387 | 1.54387 | 0.0446946 | 1.54387 | 1 | 1 | 13 | 100 | 10 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 1 | 1 | 112 | 0 | | | 2021-08-20 01:46:57,907 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | +-------------+--------------+--------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+------------+--------+---------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:46:58,177 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | Tuned, Evolution Begin and End, and Final Models 2021-08-20 01:46:58,179 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | +---------------------+----------------------------------------+-----------------------------------------------------------------+--------------------+-----------------------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+----------------------+-----------+--------+----------------------+----------------------------------------------+--------------------------------------+----------------+------------+ 2021-08-20 01:46:58,181 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | transformer | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | best_learning_rate | task | experiment_id | IS_EVOLUTION | IS_FINAL | 2021-08-20 01:46:58,183 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | |---------------------+----------------------------------------+-----------------------------------------------------------------+--------------------+-----------------------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+----------------------+-----------+--------+----------------------+----------------------------------------------+--------------------------------------+----------------+------------| 2021-08-20 01:46:58,185 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | TargetTuning1 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.9999999999999999 | 1 | 11 | 100 | 17 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 3478.51 | 0.0 | * | + | | | | | | 2021-08-20 01:46:58,187 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | TargetTuning0 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity | 1.638846516609192 | 0.04907701537013054 | 11.494299411773682 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.638846516609192 | 1.638846516609192 | 0.04907701537013054 | 1.638846516609192 | 0.9982383925811641 | 1 | 11 | 100 | 17 | False | False | 0 | 0 | 0.9997987291055966 | 0.9997987291055966 | 3478.51 | 0.006716633818293618 | | + | | | | | | 2021-08-20 01:46:58,189 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | TargetTuning2 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_center | 1.7416456937789917 | 0.05843223258852959 | 8.963703870773315 | 99 | 22 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, -1, 1, 1, 0, -1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | 1.7416456937789917 | 1.7416456937789917 | 0.05843223258852959 | 1.7416456937789917 | 0.7784653090182173 | 0.733333 | 11 | 100 | 22 | False | False | 0 | 0 | 0.9407864471847772 | 0.9407864471847772 | 2550.9 | 2.099971220061501 | | | | | | | | 2021-08-20 01:46:58,191 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning0 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | * | + | | | | | | 2021-08-20 01:46:58,193 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.6436718702316284 | 0.06142866984009743 | 123.9472188949585 | 300 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0.001 | 0.3 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6436718702316284 | 1.6436718702316284 | 0.06142866984009743 | 1.6436718702316284 | 1.0 | 1 | 13 | 100 | 14 | False | False | 0 | 0 | 0.9968636040927696 | 0.9968636040927696 | 88 | 0.1049731946050262 | | | | | | | | 2021-08-20 01:46:58,194 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning3 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | TargetTransformer_identity_noclip | 1.669759750366211 | 0.04171554744243622 | 12.761950731277466 | 117 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 50 | True | | | [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.669759750366211 | 1.669759750366211 | 0.04171554744243622 | 1.669759750366211 | 0.10296278403868692 | 0.39 | 10 | 100 | 13 | False | False | 0 | 0 | 0.981288873531444 | 0.981288873531444 | 1233.29 | 0.6361892630651612 | | | | | | | | 2021-08-20 01:46:58,196 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning8 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:8,num_as_cat:False | LightGBMModel | TargetTransformer_identity_noclip | 1.683212161064148 | 0.06572724133729935 | 39.88503384590149 | 121 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | 1.683212161064148 | 1.683212161064148 | 0.06572724133729935 | 1.683212161064148 | 0.3217904701815282 | 0.403333 | 11 | 100 | 14 | False | False | 0 | 0 | 0.9734463084375017 | 0.9734463084375017 | 1403 | 0.9101148057080886 | | | | | | | | 2021-08-20 01:46:58,198 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning4 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.6909176111221313 | 0.054173633456230164 | 6.89313268661499 | 140 | 16 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0 | 0.7 | 0.4 | 10 | 1 | 1 | 10 | 1 | 0.001 | 0 | 200000 | | True | mse | mae | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6909176111221313 | 1.6909176111221313 | 0.054173633456230164 | 1.6909176111221313 | 0.05561345182304341 | 0.466667 | 13 | 100 | 16 | False | False | 0 | 0 | 0.9690103490125975 | 0.9690103490125975 | 41.0667 | 1.067017507821158 | | | | | | | | 2021-08-20 01:46:58,200 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning7 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.6920517683029175 | 0.040378328412771225 | 72.60530877113342 | 109 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 1 | 0.9 | 0.6 | 10 | 0 | 0.0001 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6920517683029175 | 1.6920517683029175 | 0.040378328412771225 | 1.6920517683029175 | 0.5857760215875777 | 0.363333 | 13 | 100 | 17 | False | False | 0 | 0 | 0.9683608357611851 | 0.9683608357611851 | 1263.86 | 1.0901118533749148 | | | | | | | | 2021-08-20 01:46:58,202 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | FeatureModelTuning2 | PASSED | DefaultIndiv: do_te:True,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | TargetTransformer_identity_noclip | 2.080228328704834 | 0.03523514047265053 | 10.825915336608887 | 93 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 50 | True | | | [1, 1, -1, 1, 0, 1, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 2.080228328704834 | 2.080228328704834 | 0.03523514047265053 | 2.080228328704834 | 0.08734294672463383 | 0.31 | 10 | 100 | 13 | False | False | 0 | 0 | 0.7876619320558708 | 0.7876619320558708 | 980.306 | 8.994381009063602 | | | | | | | | 2021-08-20 01:46:58,204 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve1 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | | + | | | | | | 2021-08-20 01:46:58,205 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve0 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | * | + | | | | | | 2021-08-20 01:46:58,207 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve1 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | | + | | | | | | 2021-08-20 01:46:58,209 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.6436718702316284 | 0.06142866984009743 | 123.9472188949585 | 300 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0.001 | 0.3 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6436718702316284 | 1.6436718702316284 | 0.06142866984009743 | 1.6436718702316284 | 1.0 | 1 | 13 | 100 | 14 | False | False | 0 | 0 | 0.9968636040927696 | 0.9968636040927696 | 88 | 0.1049731946050262 | | | | | | | | 2021-08-20 01:46:58,211 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve3 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | TargetTransformer_identity_noclip | 1.669759750366211 | 0.04171554744243622 | 12.761950731277466 | 117 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 100 | True | | | [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.669759750366211 | 1.669759750366211 | 0.04171554744243622 | 1.669759750366211 | 0.10296278403868692 | 0.39 | 10 | 100 | 13 | False | False | 0 | 0 | 0.981288873531444 | 0.981288873531444 | 1233.29 | 0.6361892630651612 | | | | | | | | 2021-08-20 01:46:58,213 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve8 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:8,num_as_cat:False | LightGBMModel | TargetTransformer_identity_noclip | 1.683212161064148 | 0.06572724133729935 | 39.88503384590149 | 121 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | 1.683212161064148 | 1.683212161064148 | 0.06572724133729935 | 1.683212161064148 | 0.3217904701815282 | 0.403333 | 11 | 100 | 14 | False | False | 0 | 0 | 0.9734463084375017 | 0.9734463084375017 | 1403 | 0.9101148057080886 | | | | | | | | 2021-08-20 01:46:58,215 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve4 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.6909176111221313 | 0.054173633456230164 | 6.89313268661499 | 140 | 16 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0 | 0.7 | 0.4 | 10 | 1 | 1 | 10 | 1 | 0.001 | 0 | 200000 | | True | mse | mae | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 1.6909176111221313 | 1.6909176111221313 | 0.054173633456230164 | 1.6909176111221313 | 0.05561345182304341 | 0.466667 | 13 | 100 | 16 | False | False | 0 | 0 | 0.9690103490125975 | 0.9690103490125975 | 41.0667 | 1.067017507821158 | | | | | | | | 2021-08-20 01:46:58,217 C: 12% D:938.9GB M:249.0GB NODE:LOCAL1 7646 INFO | | BeginEvolve-2 | UNSCORED (ADDED AT START OF EVOLUTION) | EXTRA_FS | LightGBMModel | TargetTransformer_identity_noclip | | | | 0 | 0 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 135 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 12 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | | | 0 | 11 | 100 | 0 | False | False | 0 | 0 | | | 0 | | | | 0.049999999999999996 | | 59939c96-0150-11ec-a7e1-0242c0a8fe02 | | | 2021-08-20 01:46:58,218 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.5406694412231445 | 0.07447481155395508 | 10.2088463306427 | 300 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | | 1.5406694412231445 | 1.5406694412231445 | 0.07447481155395508 | 1.5406694412231445 | 0.8947420396877256 | 1 | 13 | 100 | 10 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 112 | 0.0 | | + | | | | True | | 2021-08-20 01:46:58,224 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.5413963794708252 | 0.07796533405780792 | 9.925466299057007 | 299 | 9 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 6 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1] | 0 | | intermediate | | 1.5413963794708252 | 1.5413963794708252 | 0.07796533405780792 | 1.5413963794708252 | 0.8699055381619167 | 0.996667 | 13 | 100 | 9 | False | False | 0 | 0 | 0.9995283898046193 | 0.9995283898046193 | 95.68 | 0.009760860517975346 | | + | | | | True | | 2021-08-20 01:46:58,226 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.5420849323272705 | 0.07796533405780792 | 10.811548471450806 | 299 | 9 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 6 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1] | 0 | | intermediate | | 1.5420849323272705 | 1.5420849323272705 | 0.07796533405780792 | 1.5420849323272705 | 0.9475651428401514 | 0.996667 | 13 | 100 | 9 | False | False | 0 | 0 | 0.9990820926432435 | 0.9990820926432435 | 95.68 | 0.019006306623555146 | | + | | | | True | | 2021-08-20 01:46:58,228 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.543484091758728 | 0.07796533405780792 | 10.248848676681519 | 299 | 9 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 6 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1] | 0 | | intermediate | | 1.543484091758728 | 1.543484091758728 | 0.07796533405780792 | 1.543484091758728 | 0.8982479971218809 | 0.996667 | 13 | 100 | 9 | False | False | 0 | 0 | 0.9981764304856702 | 0.9981764304856702 | 95.68 | 0.03779332202196063 | | + | | | | True | | 2021-08-20 01:46:58,230 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.5473862886428833 | 0.08567483723163605 | 9.63129997253418 | 299 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | | | [1, 1, -1, 1, 0, 0, 1, 0, 1, 1] | 0 | | intermediate | | 1.5473862886428833 | 1.5473862886428833 | 0.08567483723163605 | 1.5473862886428833 | 0.844123684808864 | 0.996667 | 13 | 100 | 10 | False | False | 0 | 0 | 0.9956592303621674 | 0.9956592303621674 | 111.627 | 0.09018951883983617 | | + | | | | True | | 2021-08-20 01:46:58,232 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.5571506023406982 | 0.08078832924365997 | 11.409820795059204 | 300 | 8 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 5 | 100 | True | | | [1, 1, -1, 1, 0, 0, 1, 1] | 0 | | intermediate | | 1.5571506023406982 | 1.5571506023406982 | 0.08078832924365997 | 1.5571506023406982 | 0.9999999999999999 | 1 | 13 | 100 | 8 | False | False | 0 | 0 | 0.9894158207351427 | 0.9894158207351427 | 80 | 0.22129846015942337 | | + | | | | True | | 2021-08-20 01:46:58,234 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 3.9618165493011475 | 0.08480773866176605 | 8.527729511260986 | 83 | 4 | ['InteractionsTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 1 | 100 | True | | | [1, -1, 1, 0] | 0 | | intermediate | | 3.9618165493011475 | 3.9618165493011475 | 0.08480773866176605 | 3.9618165493011475 | 0.7474025810250893 | 0.276667 | 13 | 100 | 4 | False | False | 0 | 0 | 0.3888795510975677 | 0.3888795510975677 | 4.42667 | 32.5096103979251 | | + | | | | True | | 2021-08-20 01:46:58,235 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | EndEvolve6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 4.052188873291016 | 0.05662354454398155 | 8.853854656219482 | 97 | 1 | ['OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.5 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 1 | 100 | True | | | [1] | 0 | | intermediate | | 4.052188873291016 | 4.052188873291016 | 0.05662354454398155 | 4.052188873291016 | 0.7759854265242682 | 0.323333 | 13 | 100 | 1 | False | False | 0 | 0 | 0.3802067202193068 | 0.3802067202193068 | 5.17333 | 33.7230719979507 | | + | | | | True | | 2021-08-20 01:46:58,237 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | SampleFinal6 | PASSED | RANDOM | LightGBMModel | TargetTransformer_identity_noclip | 1.5406694412231445 | 0.07447481155395508 | 10.2088463306427 | 300 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | | 1.5406694412231445 | 1.5406694412231445 | 0.07447481155395508 | 1.5406694412231445 | 0.9999999999999998 | 1 | 13 | 100 | 10 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 112 | 0.0 | | | | | | True | | 2021-08-20 01:46:58,239 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | | Final6 | PASSED | FINAL BASE MODEL 0 | LightGBMModel | TargetTransformer_identity_noclip | 1.5438722372055054 | 0.044694554060697556 | 10.2088463306427 | 300 | 10 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 100 | 500 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | 0 | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | | 1.5438722372055054 | 1.5438722372055054 | 0.044694554060697556 | 1.5438722372055054 | 0.9999999999999998 | 1 | 13 | 100 | 10 | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 112 | 0.0 | | | | | | | True | 2021-08-20 01:46:58,241 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | +---------------------+----------------------------------------+-----------------------------------------------------------------+--------------------+-----------------------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+----------------------+-----------+--------+----------------------+----------------------------------------------+--------------------------------------+----------------+------------+ 2021-08-20 01:46:58,393 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Outputting final model info. 2021-08-20 01:46:58,523 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | Pipeline Description: Final StackedEnsemble pipeline with ensemble_level=1 transforming 6 original features -> 10 features in each of 1 models each fit on 3 internal holdout splits then linearly blended: 2021-08-20 01:46:58,525 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+---------------+-------------+----------------+-----------+--------------------+-------------+--------------+-------------+--------------------+---------------+---------------+----------------+-----------------+----------------------+-------------------+------------------------------+ 2021-08-20 01:46:58,527 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | index | Type | Num Folds | Model Weight | booster | model_class_name | max_depth | max_leaves | subsample | colsample_bytree | tree_method | grow_policy | random_state | learning rate | Target Transformer | Fitted features | Fit iterations [each fold] | 2021-08-20 01:46:58,529 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | |---------+---------------+-------------+----------------+-----------+--------------------+-------------+--------------+-------------+--------------------+---------------+---------------+----------------+-----------------+----------------------+-------------------+------------------------------| 2021-08-20 01:46:58,530 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 0 | LightGBMModel | 3 | 1 | lightgbm | LightGBMModel | 24 | 16 | 0.8 | 0.55 | | lossguide | 1037348886 | 0.05 | identity_noclip | 10 | [500, 500, 473] | 2021-08-20 01:46:58,532 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+---------------+-------------+----------------+-----------+--------------------+-------------+--------------+-------------+--------------------+---------------+---------------+----------------+-----------------+----------------------+-------------------+------------------------------+ 2021-08-20 01:46:58,534 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+-----------+------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------+----------------+--------------------------------------------+--------------------+----------+----------+----------------+---------------+-----------+-------+------------+----------------+----------+---------+-------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+----------------+----------------+----------------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+------------+--------+ 2021-08-20 01:46:58,536 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | index | fold_id | model_id | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | labels | label_counts | _build_info | model_class_name | gpu_id | n_jobs | random_state | time_column | encoder | tgc | pred_gap | pred_periods | target | ufapt | tsp | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | model_origin | optuna_trial | optuna_trial_state | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_FINAL | task | 2021-08-20 01:46:58,537 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | |---------+-----------+------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------+----------------+--------------------------------------------+--------------------+----------+----------+----------------+---------------+-----------+-------+------------+----------------+----------+---------+-------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+----------------+----------------+----------------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+------------+--------| 2021-08-20 01:46:58,539 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 0 | 0 | 0 | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | None | | {'commit': '4d0fa39', 'version': '1.10.0'} | LightGBMModel | 0 | 4 | 1037348886 | | | | | | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 100 | 500 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | RANDOM | | unused | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | 0 | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | True | | 2021-08-20 01:46:58,541 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 1 | 1 | 0 | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | None | | {'commit': '4d0fa39', 'version': '1.10.0'} | LightGBMModel | 0 | 4 | 1037348886 | | | | | | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 100 | 500 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | RANDOM | | unused | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | 0 | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | True | | 2021-08-20 01:46:58,542 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 2 | 2 | 0 | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | None | | {'commit': '4d0fa39', 'version': '1.10.0'} | LightGBMModel | 0 | 4 | 1037348886 | | | | | | | | | gbdt | True | 0.05 | lossguide | 24 | 16 | 64 | 1 | 0 | 0.001 | 0.55 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 100 | 500 | gain | 16 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | RANDOM | | unused | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 7 | 100 | True | 0 | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0] | 0 | | intermediate | True | | 2021-08-20 01:46:58,544 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+-----------+------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------+----------------+--------------------------------------------+--------------------+----------+----------+----------------+---------------+-----------+-------+------------+----------------+----------+---------+-------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+----------------+----------------+----------------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+---------------------------------+--------------------+-----------------------+-------------------------------+------------+--------+ 2021-08-20 01:46:58,546 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +--------------+----------+---------+--------------+--------------------+ 2021-08-20 01:46:58,547 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | Individual | Model | do_te | num_as_cat | interpretability | 2021-08-20 01:46:58,549 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | |--------------+----------+---------+--------------+--------------------| 2021-08-20 01:46:58,551 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 0 | LIGHTGBM | True | True | 8 | 2021-08-20 01:46:58,552 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +--------------+----------+---------+--------------+--------------------+ 2021-08-20 01:46:58,554 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | Validation scores on out-of-fold predictions: 2021-08-20 01:46:58,556 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+---------+----------+--------+---------+---------+---------+----------+----------+---------+---------+---------+ 2021-08-20 01:46:58,557 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | index | RMSE | GINI | MAE | MAPE | MER | MSE | R2 | R2COD | RMSLE | RMSPE | SMAPE | 2021-08-20 01:46:58,559 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | |---------+---------+----------+--------+---------+---------+---------+----------+----------+---------+---------+---------| 2021-08-20 01:46:58,561 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 0 | 1.54457 | 0.952609 | 1.1483 | 10.0608 | 6.53739 | 2.38568 | 0.904693 | 0.904668 | 1e+36 | 20.0731 | 9.3281 | 2021-08-20 01:46:58,562 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+---------+----------+--------+---------+---------+---------+----------+----------+---------+---------+---------+ 2021-08-20 01:46:58,564 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+--------+--------------+-------------------+---------------------------+---------------------------+---------------------------+---------------------------+----------------+----------------+----------------+----------------------------+----------------------------+----------------------------+---------------------------+----------------+ 2021-08-20 01:46:58,566 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | index | Fold | Train rows | Validation rows | Validation score | RMSE | GINI | MAE | MAPE | MER | MSE | R2 | R2COD | RMSLE | RMSPE | SMAPE | 2021-08-20 01:46:58,567 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | |---------+--------+--------------+-------------------+---------------------------+---------------------------+---------------------------+---------------------------+----------------+----------------+----------------+----------------------------+----------------------------+----------------------------+---------------------------+----------------| 2021-08-20 01:46:58,569 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 0 | 0 | 666 | 334 | 1.590796 +/- 1.192093e-07 | 1.590796 +/- 1.192093e-07 | 0.950988 +/- 1.110223e-16 | 1.152181 +/- 1.192093e-07 | 10.8374 +/- 0 | 6.130025 +/- 0 | 2.53063 +/- 0 | 0.9015308 +/- 1.110223e-16 | 0.9008638 +/- 1.110223e-16 | 0.131184 +/- 0 | 23.17051 +/- 0 | 9.63089 +/- 0 | 2021-08-20 01:46:58,571 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 1 | 1 | 667 | 333 | 1.557085 +/- 1.192093e-07 | 1.557085 +/- 1.192093e-07 | 0.9544022 +/- 0 | 1.180646 +/- 0 | 9.502723 +/- 0 | 7.077334 +/- 0 | 2.424515 +/- 0 | 0.903681 +/- 1.110223e-16 | 0.9036063 +/- 0 | 0.1185262 +/- 1.490116e-08 | 14.57171 +/- 1.776357e-15 | 9.191461 +/- 0 | 2021-08-20 01:46:58,573 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | 2 | 2 | 667 | 333 | 1.483736 +/- 0 | 1.483736 +/- 0 | 0.9531888 +/- 0 | 1.112071 +/- 1.192093e-07 | 9.839868 +/- 0 | 6.30881 +/- 0 | 2.201471 +/- 0 | 0.9098755 +/- 1.110223e-16 | 0.9097531 +/- 0 | 1e+36 +/- 1.47574e+20 | 21.42841 +/- 3.552714e-15 | 9.161048 +/- 0 | 2021-08-20 01:46:58,574 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +---------+--------+--------------+-------------------+---------------------------+---------------------------+---------------------------+---------------------------+----------------+----------------+----------------+----------------------------+----------------------------+----------------------------+---------------------------+----------------+ 2021-08-20 01:46:58,576 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +----------+-----------------------------------------------------------------------------------------------------+-------------+-------------------+ 2021-08-20 01:46:58,578 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | Scorer | Final ensemble scores +/- standard deviation on validation (internal or external holdout(s)) data | Optimized | Better score is | 2021-08-20 01:46:58,579 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | |----------+-----------------------------------------------------------------------------------------------------+-------------+-------------------| 2021-08-20 01:46:58,581 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | RMSE | 1.543872 +/- 0.04469455 | * | lower | 2021-08-20 01:46:58,583 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | GINI | 0.9528597 +/- 0.001413133 | | higher | 2021-08-20 01:46:58,584 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | MAE | 1.148299 +/- 0.02813014 | | lower | 2021-08-20 01:46:58,586 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | MAPE | 10.06 +/- 0.5666763 | | lower | 2021-08-20 01:46:58,588 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | MER | 6.50539 +/- 0.4109592 | | lower | 2021-08-20 01:46:58,590 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | MSE | 2.385539 +/- 0.1371758 | | lower | 2021-08-20 01:46:58,591 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | R2 | 0.9050291 +/- 0.00353755 | | higher | 2021-08-20 01:46:58,593 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | R2COD | 0.9047411 +/- 0.00371669 | | higher | 2021-08-20 01:46:58,595 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | RMSLE | 3.333333e+35 +/- 4.714045e+35 | | lower | 2021-08-20 01:46:58,596 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | RMSPE | 19.72355 +/- 3.711674 | | lower | 2021-08-20 01:46:58,598 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | | SMAPE | 9.3278 +/- 0.2146766 | | lower | 2021-08-20 01:46:58,600 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | +----------+-----------------------------------------------------------------------------------------------------+-------------+-------------------+ 2021-08-20 01:46:58,601 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Experiment Progress: 79.9 % 2021-08-20 01:46:58,603 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Scored 286/310 models on 31 features. Last Scored [] 2021-08-20 01:46:58,605 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:46:58,609 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.543872 +/- 0.04469455 [Tournament: 1.543872 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:46:58,621 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 7 transformers creating 10 total features and 10 features for model: 1.543872 RMSE 2021-08-20 01:46:58,630 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:46:58,637 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:46:58,641 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:46:58,644 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.570193 2021-08-20 01:46:58,647 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.277387 2021-08-20 01:46:58,651 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 3 10_InteractionAdd:X_0:X_1 0.225715 2021-08-20 01:46:58,654 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.184935 2021-08-20 01:46:58,658 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 5 0_X_0 0.130198 2021-08-20 01:46:58,661 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 6 1_X_1 0.124231 2021-08-20 01:46:58,664 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.036013 2021-08-20 01:46:58,667 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 8 10_InteractionSub:X_0:X_1 0.017968 2021-08-20 01:46:58,671 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 DATA | 9 7_X_7 0.010039 2021-08-20 01:46:58,676 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Creating MOJO scoring pipeline (expert setting was set to 'auto') 2021-08-20 01:46:58,679 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Creating scoring pipelines 2021-08-20 01:46:58,683 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Building MOJO pipeline... 2021-08-20 01:46:58,687 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Creating MOJO pipeline in '/opt/h2oai/dai/./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/mojo_pipeline'... 2021-08-20 01:46:58,690 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Building MOJO runtime environment... 2021-08-20 01:46:59,135 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Exporting additional fitted model meta info to /opt/h2oai/dai/./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle.meta.json 2021-08-20 01:46:59,139 C: 14% D:938.9GB M:249.1GB NODE:LOCAL1 7646 INFO | Building MOJO... 2021-08-20 01:47:02,002 C: 16% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Creating pipeline visualization. 2021-08-20 01:47:02,876 C: 16% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Done generating .dot pipeline visualization file(s). 2021-08-20 01:47:02,883 C: 16% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | MOJO pipeline created. 2021-08-20 01:47:03,067 C: 12% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Size of MOJO (pipeline.mojo): 512.7kB 2021-08-20 01:47:03,074 C: 12% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Running MOJO latency benchmark 2021-08-20 01:47:04,316 C: 12% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | C++ MOJO scoring latency per row: 0.0571 millis 2021-08-20 01:47:07,138 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (15, 6) start. 2021-08-20 01:47:07,371 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:07,376 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict (15, 10) start. 2021-08-20 01:47:07,492 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:47:07,499 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict (15, 10) end. Took 0.12449 seconds. 2021-08-20 01:47:07,501 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (15, 6) end. Took 0.36737 seconds. 2021-08-20 01:47:07,668 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (15, 6) start. 2021-08-20 01:47:07,879 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:07,884 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict (15, 10) start. 2021-08-20 01:47:08,007 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:47:08,013 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict (15, 10) end. Took 0.13038 seconds. 2021-08-20 01:47:08,015 C: 16% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (15, 6) end. Took 0.35141 seconds. 2021-08-20 01:47:08,185 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (15, 6) start. 2021-08-20 01:47:08,440 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:08,446 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict (15, 10) start. 2021-08-20 01:47:08,585 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:47:08,592 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict (15, 10) end. Took 0.14726 seconds. 2021-08-20 01:47:08,593 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (15, 6) end. Took 0.41258 seconds. 2021-08-20 01:47:08,701 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | C++ MOJO mini acceptance test PASSED. 2021-08-20 01:47:08,707 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Java MOJO mini acceptance test PASSED. 2021-08-20 01:47:09,108 C: 25% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) start. 2021-08-20 01:47:09,347 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:09,353 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) start. 2021-08-20 01:47:09,476 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:47:09,487 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) end. Took 0.13598 seconds. 2021-08-20 01:47:09,490 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) end. Took 0.38619 seconds. 2021-08-20 01:47:09,630 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) start. 2021-08-20 01:47:09,857 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:09,863 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) start. 2021-08-20 01:47:09,988 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:47:09,995 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) end. Took 0.13351 seconds. 2021-08-20 01:47:09,997 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) end. Took 0.37176 seconds. 2021-08-20 01:47:10,154 C: 24% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) start. 2021-08-20 01:47:10,447 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:10,454 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) start. 2021-08-20 01:47:10,576 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:47:10,583 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) end. Took 0.13189 seconds. 2021-08-20 01:47:10,585 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) end. Took 0.43611 seconds. 2021-08-20 01:47:10,715 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Java (Shapley) MOJO mini acceptance test PASSED. 2021-08-20 01:47:11,124 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) start. 2021-08-20 01:47:11,415 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:11,421 C: 26% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) start. 2021-08-20 01:47:11,553 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:47:11,573 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) end. Took 0.15328 seconds. 2021-08-20 01:47:11,575 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) end. Took 0.45895 seconds. 2021-08-20 01:47:11,752 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) start. 2021-08-20 01:47:12,018 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:12,025 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) start. 2021-08-20 01:47:12,148 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:47:12,170 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) end. Took 0.14720 seconds. 2021-08-20 01:47:12,172 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) end. Took 0.42364 seconds. 2021-08-20 01:47:12,330 C: 20% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) start. 2021-08-20 01:47:12,648 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:47:12,657 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) start. 2021-08-20 01:47:12,786 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:47:12,812 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (15, 10) model predict Shapley (15, 10) end. Took 0.15831 seconds. 2021-08-20 01:47:12,815 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (15, 6) end. Took 0.48782 seconds. 2021-08-20 01:47:12,921 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Putting MOJO into fitted_model.pickle for later use. 2021-08-20 01:47:12,924 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Fitted model pickle size before MOJO injection: 296.0kB 2021-08-20 01:47:13,000 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Size of fitted python (/opt/h2oai/dai/./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle9f988a01-6): 443.6kB written in 0.0727644 seconds (after injecting MOJO) 2021-08-20 01:47:13,004 C: 25% D:938.8GB M:248.9GB NODE:LOCAL1 7646 INFO | Assembling MOJO pipeline... 2021-08-20 01:47:18,421 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | MOJO pipeline build completed successfully in 19.73248 seconds. 2021-08-20 01:47:18,431 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Finished building MOJO pipeline 2021-08-20 01:47:18,433 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Building Python scoring pipeline... 2021-08-20 01:47:18,436 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Zipping up custom recipes. 2021-08-20 01:47:18,438 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Creating scoring pipeline named scoring_h2oai_experiment_59939c96_0150_11ec_a7e1_0242c0a8fe02 2021-08-20 01:47:18,485 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Creating thrift IDL... 2021-08-20 01:47:18,490 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Collecting wheels... 2021-08-20 01:47:18,494 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing requirements.txt... 2021-08-20 01:47:18,499 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing environment.yml... 2021-08-20 01:47:18,503 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing example.py... 2021-08-20 01:47:18,508 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing http_server.py... 2021-08-20 01:47:18,513 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing tcp_server.py... 2021-08-20 01:47:18,516 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing setup.py... 2021-08-20 01:47:18,520 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing example_client.py 2021-08-20 01:47:18,525 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Writing run_http_client.sh 2021-08-20 01:47:18,538 C: 9% D:938.8GB M:249.0GB NODE:LOCAL1 7646 INFO | Building scoring wheel... 2021-08-20 01:48:02,369 C: 13% D:934.5GB M:249.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 190.8GB, since last ping: 32.0MB/s. CPU memory usage: 534.7MB, max: 911.3MB CPU: 99% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 13 (Disk: Read: 0B/s Write: 23.6MB/s Size: 2.3GB) (Connections: 34 Fds: 141 WinHandles: 0 Threads: 9 Maps: 2400 WinOpenFiles: 0) (System-Wide CPU: User: 8% Nice: 0% System: 3% Wait: 10% DAIActiveprocs: 1 DAIprocs: 23) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:create_scoring_pipelinescreate_scoring_pipelines-make_holdout_preds_2-make_holdout_preds_2-make_holdout_preds_2] 2021-08-20 01:48:08,287 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | Scoring wheel build completed successfully in 49.85004 seconds. 2021-08-20 01:48:08,295 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | Finished building scoring pipeline 2021-08-20 01:48:08,299 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:08,303 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | ============================================================================================== 2021-08-20 01:48:08,307 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | Experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02 FINISHED 2021-08-20 01:48:08,311 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | ============================================================================================== 2021-08-20 01:48:08,314 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:08,318 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 INFO | Collecting system info during process shutdown 2021-08-20 01:48:08,368 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | MemTotal: 264019636 kB 2021-08-20 01:48:08,371 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | MemFree: 46556000 kB 2021-08-20 01:48:08,373 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | MemAvailable: 244119144 kB 2021-08-20 01:48:08,375 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Buffers: 6349696 kB 2021-08-20 01:48:08,377 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Cached: 181477260 kB 2021-08-20 01:48:08,380 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | SwapCached: 2732 kB 2021-08-20 01:48:08,382 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Active: 118798604 kB 2021-08-20 01:48:08,384 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Inactive: 85005056 kB 2021-08-20 01:48:08,386 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Active(anon): 14331684 kB 2021-08-20 01:48:08,388 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Inactive(anon): 1787384 kB 2021-08-20 01:48:08,390 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Active(file): 104466920 kB 2021-08-20 01:48:08,392 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Inactive(file): 83217672 kB 2021-08-20 01:48:08,394 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Unevictable: 0 kB 2021-08-20 01:48:08,396 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Mlocked: 0 kB 2021-08-20 01:48:08,398 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | SwapTotal: 134080508 kB 2021-08-20 01:48:08,401 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | SwapFree: 134067140 kB 2021-08-20 01:48:08,403 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Dirty: 371700 kB 2021-08-20 01:48:08,405 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Writeback: 0 kB 2021-08-20 01:48:08,407 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | AnonPages: 15975008 kB 2021-08-20 01:48:08,409 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Mapped: 1435972 kB 2021-08-20 01:48:08,411 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Shmem: 141776 kB 2021-08-20 01:48:08,413 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Slab: 12303000 kB 2021-08-20 01:48:08,416 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | SReclaimable: 10762764 kB 2021-08-20 01:48:08,418 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | SUnreclaim: 1540236 kB 2021-08-20 01:48:08,420 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | KernelStack: 22752 kB 2021-08-20 01:48:08,422 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | PageTables: 144564 kB 2021-08-20 01:48:08,424 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | NFS_Unstable: 0 kB 2021-08-20 01:48:08,426 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Bounce: 0 kB 2021-08-20 01:48:08,428 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | WritebackTmp: 0 kB 2021-08-20 01:48:08,430 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | CommitLimit: 266090324 kB 2021-08-20 01:48:08,432 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Committed_AS: 60468976 kB 2021-08-20 01:48:08,434 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | VmallocTotal: 34359738367 kB 2021-08-20 01:48:08,436 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | VmallocUsed: 0 kB 2021-08-20 01:48:08,438 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | VmallocChunk: 0 kB 2021-08-20 01:48:08,440 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | HardwareCorrupted: 0 kB 2021-08-20 01:48:08,443 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | AnonHugePages: 0 kB 2021-08-20 01:48:08,445 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | CmaTotal: 0 kB 2021-08-20 01:48:08,447 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | CmaFree: 0 kB 2021-08-20 01:48:08,449 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | HugePages_Total: 0 2021-08-20 01:48:08,451 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | HugePages_Free: 0 2021-08-20 01:48:08,453 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | HugePages_Rsvd: 0 2021-08-20 01:48:08,455 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | HugePages_Surp: 0 2021-08-20 01:48:08,457 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Hugepagesize: 2048 kB 2021-08-20 01:48:08,459 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | DirectMap4k: 105137848 kB 2021-08-20 01:48:08,461 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | DirectMap2M: 156870656 kB 2021-08-20 01:48:08,463 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | DirectMap1G: 8388608 kB 2021-08-20 01:48:08,465 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2021-08-20 01:48:08,501 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | Fri Aug 20 01:48:08 2021 2021-08-20 01:48:08,504 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | +-----------------------------------------------------------------------------+ 2021-08-20 01:48:08,506 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | NVIDIA-SMI 460.73.01 Driver Version: 460.73.01 CUDA Version: 11.2 | 2021-08-20 01:48:08,508 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | |-------------------------------+----------------------+----------------------+ 2021-08-20 01:48:08,510 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | 2021-08-20 01:48:08,512 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | 2021-08-20 01:48:08,514 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | | | MIG M. | 2021-08-20 01:48:08,516 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | |===============================+======================+======================| 2021-08-20 01:48:08,518 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 0 TITAN X (Pascal) On | 00000000:02:00.0 Off | N/A | 2021-08-20 01:48:08,520 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 29% 42C P8 11W / 250W | 323MiB / 12195MiB | 0% Default | 2021-08-20 01:48:08,522 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | | | N/A | 2021-08-20 01:48:08,525 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | +-------------------------------+----------------------+----------------------+ 2021-08-20 01:48:08,527 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 1 TITAN X (Pascal) On | 00000000:81:00.0 Off | N/A | 2021-08-20 01:48:08,529 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 39% 65C P2 58W / 250W | 185MiB / 12196MiB | 0% Default | 2021-08-20 01:48:08,531 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | | | N/A | 2021-08-20 01:48:08,533 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | +-------------------------------+----------------------+----------------------+ 2021-08-20 01:48:08,535 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2021-08-20 01:48:08,537 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | +-----------------------------------------------------------------------------+ 2021-08-20 01:48:08,539 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | Processes: | 2021-08-20 01:48:08,541 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | GPU GI CI PID Type Process name GPU Memory | 2021-08-20 01:48:08,543 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | ID ID Usage | 2021-08-20 01:48:08,545 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | |=============================================================================| 2021-08-20 01:48:08,547 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 0 N/A N/A 2115 G /usr/lib/xorg/Xorg 137MiB | 2021-08-20 01:48:08,549 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 0 N/A N/A 12601 C ...cp://192.168.254.3:45687] 181MiB | 2021-08-20 01:48:08,551 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | | 1 N/A N/A 12603 C ...cp://192.168.254.3:38537] 181MiB | 2021-08-20 01:48:08,553 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | +-----------------------------------------------------------------------------+ 2021-08-20 01:48:08,556 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2021-08-20 01:48:08,613 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 6073 0.0 0.0 86944 60752 ? S Aug18 0:05 | \_ /opt/h2oai/dai/python/bin/python3.8 /opt/h2oai/dai/python/bin/jupyter-notebook --ip=0.0.0.0 --no-browser --allow-root 2021-08-20 01:48:08,615 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 6365 0.5 0.0 268068 6144 ? Sl Aug18 8:17 \_ /opt/h2oai/dai/redis-server 0.0.0.0:6379 2021-08-20 01:48:08,617 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 6366 3.4 0.7 74368980 1985548 ? Sl Aug18 55:32 \_ /opt/h2oai/dai/jre/bin/java -Xmx64457m -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -DdoUBench=false -Ddai.tmp=./tmp -jar /opt/h2oai/dai/h2o.jar -ip 127.0.0.1 -web_ip 127.0.0.1 -name H2O-MLI-DAI-20500 -flatfile networkip.txt -port 12348 -nthreads 8 2021-08-20 01:48:08,619 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 6367 0.0 0.0 10392572 51904 ? Sl Aug18 1:17 \_ /opt/h2oai/dai/jre/bin/java -Xmx5g -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -jar /opt/h2oai/dai/vis-data-server.jar -p 12346 -a 127.0.0.1 2021-08-20 01:48:08,621 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 6378 5.3 0.5 6312088 1450700 ? Sl Aug18 86:24 \_ h2oai-DriverlessAI 2021-08-20 01:48:08,623 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 7646 0.2 0.1 3843000 321596 ? S Aug18 3:48 | \_ h2oai-DriverlessAI 2021-08-20 01:48:08,625 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 7647 0.0 0.1 3845208 325092 ? S Aug18 0:00 | \_ h2oai-DriverlessAI 2021-08-20 01:48:08,627 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 9276 6.1 0.2 4986408 605220 ? Sl Aug18 98:13 | \_ h2oai-DAI-worker_NODE:LOCAL1:stats 2021-08-20 01:48:08,629 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 23218 6.3 0.1 4989012 378624 ? Sl 00:27 5:04 | \_ h2oai-DAI-worker_NODE:LOCAL1:stats_auto_dl_easy_api_774bc95a-014d-11ec-a7e1-0242c0a8fe02_bd972b2b 2021-08-20 01:48:08,631 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 23450 4.1 0.2 5542640 652180 ? Sl 00:27 3:17 | | \_ |#h2oai-774bc95a-014d-11ec-a7e1-0242c0a8fe02_bd972b2b-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_2_batch_4-5_for_pop_size:_24)_score 1 (1) (True) [] [] 2021-08-20 01:48:08,633 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 23466 33.0 0.1 5253732 380336 ? S 00:27 26:29 | | \_ h2oai-774bc95a-014d-11ec-a7e1-0242c0a8fe02_bd972b2b_ping_system_stats__ping__fork_940 2021-08-20 01:48:08,635 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 23473 3.3 0.1 5249144 362076 ? S 00:27 2:43 | | \_ h2oai-774bc95a-014d-11ec-a7e1-0242c0a8fe02_bd972b2b_ping_server_health__ping__fork_45830 2021-08-20 01:48:08,637 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 21208 81.0 0.2 5608600 699424 ? R 01:48 0:00 | | \_ #_#h2oai-774bc95a-014d-11ec-a7e1-0242c0a8fe02_bd972b2b-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_2_batch_4-5_for_pop_size:_24)_scorescore_model 2021-08-20 01:48:08,639 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 21215 0.0 0.2 5605332 696152 ? R 01:48 0:00 | | \_ #_#h2oai-774bc95a-014d-11ec-a7e1-0242c0a8fe02_bd972b2b-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_2_batch_4-5_for_pop_size:_24)_scorescore_model 2021-08-20 01:48:08,641 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 36973 6.2 0.1 4988756 378420 ? Sl 00:48 3:44 | \_ h2oai-DAI-worker_NODE:LOCAL1:stats_auto_dl_easy_api_59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823 2021-08-20 01:48:08,643 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 37201 6.0 0.1 7653048 484588 ? Sl 00:48 3:35 | \_ #h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:finally 2021-08-20 01:48:08,645 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 37252 28.2 0.1 5253732 379508 ? S 00:48 16:46 | \_ h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823_ping_system_stats__ping__fork_740 2021-08-20 01:48:08,647 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 37262 3.5 0.1 5248888 352220 ? S 00:48 2:05 | \_ h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823_ping_server_health__ping__fork_33890 2021-08-20 01:48:08,650 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 21239 0.0 0.0 13304 3008 ? S 01:48 0:00 | \_ /bin/sh -c ps -auxwf | grep 'h2oai\|dask' 2021-08-20 01:48:08,652 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 21241 0.0 0.0 6384 2188 ? S 01:48 0:00 | \_ grep h2oai\|dask 2021-08-20 01:48:08,654 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 7603 0.0 0.1 3865444 346820 ? S Aug18 0:01 \_ #_#_h2oai-DriverlessAI_start_h2o_recipes__start_h2o_recipes 2021-08-20 01:48:08,656 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2121 7716 3.4 0.7 40100296 1954652 ? Ssl Aug18 54:51 \_ /opt/h2oai/dai/python/bin/java -ea -DdoUBench=false -cp /opt/h2oai/dai/python/lib/python3.8/site-packages/h2o/backend/bin/h2o.jar water.H2OApp -ip 127.0.0.1 -web_ip 127.0.0.1 -port 50361 -ice_root /opt/h2oai/dai/tmp/contrib/h2o_tmp -nthreads 8 -log_dir /opt/h2oai/dai/tmp/contrib/h2o_log -name DAI-H2O-RECIPES-1.10. -log_level INFO 2021-08-20 01:48:08,658 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 19982 0.0 0.0 10340 3100 ? S 00:26 0:00 \_ make CI=1 BUILD_NUM=616 REGISTRY_PREFIX=harbor.h2o.ai/ DOCKER_BINARY=docker GCP_CREDENTIALS_JSON=/home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/20f84eaf-06f2-4b95-bb56-eacc6309497f/jenkins_gcs_gbq_test_auth.json ADDITIONAL_DOCKER_ARGS=--dns 172.16.0.200 \ -v ${GCP_CREDENTIALS_JSON}:/${GCP_CREDENTIALS_JSON} \ -v ${DRIVERLESS_AI_CONFIGURATION_FILE}:/${DRIVERLESS_AI_CONFIGURATION_FILE} \ -v ${DAI_SSL_PRIVATE_KEY}:/etc/dai/private_key.pem \ -v ${DAI_SSL_CERT}:/etc/dai/cert.pem \ -v /home/0xdiag:/home/0xdiag:ro \ -v /mnt/0xcustomer-datasets:/mnt/0xcustomer-datasets:ro \ -v `pwd`/mojo_data_collection_test_scoring_2gpu/1.10.0:/opt/h2oai/mojo_data_collection_test_scoring_2gpu/1.10.0 \ -v `pwd`/core-dumps/:/tmp/cores \ -e "DRIVERLESS_AI_GCS_PATH_TO_SERVICE_ACCOUNT_JSON"="/${GCP_CREDENTIALS_JSON}" \ -e "DRIVERLESS_AI_CONFIG_FILE=/${DRIVERLESS_AI_CONFIGURATION_FILE}" \ -e "H2OAI_MIGRATION_DATA_DIR=/home/0xdiag/migration/" \ -e "H2OAI_DATA_DIR=/home/0xdiag/" \ -e "H2OAI_SCORER_TEMPLATE_DIR=/opt/h2oai/dai/h2oai_scorer/" \ -e "H2O_BIN_DIR=/opt/h2oai/dai/" \ -e "H2OAI_TESTS_COLLECT_MOJO_DIR=/opt/h2oai/mojo_data_collection_test_scoring_2gpu/1.10.0" \ -e "JARS_DIR=/opt/h2oai/dai/" \ -e "GIT_HASH=${GIT_HASH}" \ -e "NATIVE_PIPELINE_MIGRATION_TESTS=false" \ -e "JENKINS_TEST_START_TIME=1629419212" \ -e "JENKINS_TEST_MAX_DURATION_IN_MIN=171" LICENSE_PATH=/home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/license.sig BRANCH_NAME=dev SCORING_PIPELINE_INSTALL_DEPENDENCIES=0 MIGRATION_STATE_DIR=tests/migration/ centos7_cuda11.2.2_test_scoring_2gpu_in_docker 2021-08-20 01:48:08,660 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 21109 0.0 0.0 1124468 58172 ? Sl 00:26 0:00 \_ docker run --runtime nvidia --rm --pid=host --init --privileged --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit core=-1 --shm-size=256m -v /home/0xdiag:/home/0xdiag:ro -v /etc/passwd:/etc/passwd:ro -v /etc/group:/etc/group:ro -u 2117:2117 -e HOST_HOSTNAME=mr-dl3 -e HOME=/h2oai -e SCORING_PIPELINE_INSTALL_DEPENDENCIES=0 -e MIGRATION_STATE_DIR=tests/migration/ -e DRIVERLESS_AI_LICENSE_FILE=/license/license.sig -e CI=1 -e GIT_HASH=db1fd37703297b7270c2ca685464d2ba4cf1801b -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/build:/h2oai/build -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/demo:/h2oai/demo -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/golden.results:/h2oai/golden.results -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/tests:/h2oai/tests -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/tmp:/h2oai/tmp -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/tmp_alt:/h2oai/tmp_alt -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/h2oai_autoreport:/h2oai/h2oai_autoreport -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/license.sig:/license/license.sig -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/drivers/clients:/h2oai/drivers/clients -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/dist:/h2oai/dist --entrypoint bash --workdir /h2oai --dns 172.16.0.200 -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/20f84eaf-06f2-4b95-bb56-eacc6309497f/jenkins_gcs_gbq_test_auth.json://home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/20f84eaf-06f2-4b95-bb56-eacc6309497f/jenkins_gcs_gbq_test_auth.json -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/472f5fe5-b12f-48c8-a969-fe07825a5bcb/config.toml://home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/472f5fe5-b12f-48c8-a969-fe07825a5bcb/config.toml -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/90e51cad-2123-47bf-a0d7-4289d547cb08/private_key.pem:/etc/dai/private_key.pem -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/31209440-6e83-4763-8e42-8449c235d9ef/cert.pem:/etc/dai/cert.pem -v /home/0xdiag:/home/0xdiag:ro -v /mnt/0xcustomer-datasets:/mnt/0xcustomer-datasets:ro -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/mojo_data_collection_test_scoring_2gpu/1.10.0:/opt/h2oai/mojo_data_collection_test_scoring_2gpu/1.10.0 -v /home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3/test_scoring_2gpu-x86_64-11.2.2/core-dumps/:/tmp/cores -e DRIVERLESS_AI_GCS_PATH_TO_SERVICE_ACCOUNT_JSON=//home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/20f84eaf-06f2-4b95-bb56-eacc6309497f/jenkins_gcs_gbq_test_auth.json -e DRIVERLESS_AI_CONFIG_FILE=//home/jenkins/slave_dir_from_mr-0xb1/workspace/dai-native-pipeline-nightly_dev@3@tmp/secretFiles/472f5fe5-b12f-48c8-a969-fe07825a5bcb/config.toml -e H2OAI_MIGRATION_DATA_DIR=/home/0xdiag/migration/ -e H2OAI_DATA_DIR=/home/0xdiag/ -e H2OAI_SCORER_TEMPLATE_DIR=/opt/h2oai/dai/h2oai_scorer/ -e H2O_BIN_DIR=/opt/h2oai/dai/ -e H2OAI_TESTS_COLLECT_MOJO_DIR=/opt/h2oai/mojo_data_collection_test_scoring_2gpu/1.10.0 -e JARS_DIR=/opt/h2oai/dai/ -e GIT_HASH=db1fd37703297b7270c2ca685464d2ba4cf1801b -e NATIVE_PIPELINE_MIGRATION_TESTS=false -e JENKINS_TEST_START_TIME=1629419212 -e JENKINS_TEST_MAX_DURATION_IN_MIN=171 harbor.h2o.ai/h2oai/dai-centos7-x86_64:1.10.0-cuda11.2.2-nightly_dev.616.jenkins-test -c cp -Rv /tmp/dai_artifacts/deps . && cp /tmp/dai_artifacts/redis-server redis-server && cp /tmp/dai_artifacts/minio minio && /opt/h2oai/dai/dai-env.sh make -k test_scoring_2gpu 2021-08-20 01:48:08,662 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 21205 0.0 0.0 13300 3136 ? Ss 00:27 0:00 \_ bash -c cp -Rv /tmp/dai_artifacts/deps . && cp /tmp/dai_artifacts/redis-server redis-server && cp /tmp/dai_artifacts/minio minio && /opt/h2oai/dai/dai-env.sh make -k test_scoring_2gpu 2021-08-20 01:48:08,664 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14600 0.0 0.0 13304 3180 ? S 00:42 0:00 | \_ /bin/bash -o pipefail -c PYTHONPATH=`pwd` DAI_WORKER_MODE="multinode" dai_worker_mode="multinode" dai_allow_non_dai_dask_cluster_for_testing=1 DAI_DUMMY=1 DAI_REPRODUCIBLE=1 DAI_WORKER_REMOTE_PROCESSORS=$(($((40 / $((0 == 1 ? 20 : 4)))) < 20 ? $((40 / $((0 == 1 ? 20 : 4)))) : 20)) DAI_WORKER_PRIORITY_QUEUES_PROCESSORS=40 DRIVERLESS_AI_HARD_ASSERTS=1 DRIVERLESS_AI_DEBUG_DAIMODEL_LEVEL=1 dai_show_full_pipeline_details=1 DRIVERLESS_AI_GA_OPT_IN=0 DRIVERLESS_AI_MAX_CORES=$((0 == 1 ? 20 : 4)) DAI_USE_UUIDS=0 DD=1 DAI_DEBUG_PRINT_SERVER=1 dai_benchmark_mojo_latency_auto_size_limit=100000 python -u -m pytest --color=yes --durations=20 -s -v --instafail --timeout=$(( $(( $((171 * 60)) - $(( `date +%s` - 1629419212 )) )) > 60 ? $(( $((171 * 60)) - $(( `date +%s` - 1629419212 )) )) : 60 )) --junit-xml=build/test-reports/h2oai-scoring-test_gpu_test_scoring_gpu_rapids_bert.xml -n $(($((40 / $((0 == 1 ? 20 : 4)))) < 20 ? $((40 / $((0 == 1 ? 20 : 4)))) : 20)) -m gpu tests/test_scoring/test_scoring_package.py tests/test_scoring_mojo 2>> ./tmp/h2oai-test_scoring_gpu_rapids_bert.26526_2021.08.20-00:40:16".log" 2021-08-20 01:48:08,666 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14606 0.0 0.0 803796 44816 ? Sl 00:42 0:01 | \_ python -u -m pytest --color=yes --durations=20 -s -v --instafail --timeout=9316 --junit-xml=build/test-reports/h2oai-scoring-test_gpu_test_scoring_gpu_rapids_bert.xml -n 10 -m gpu tests/test_scoring/test_scoring_package.py tests/test_scoring_mojo 2021-08-20 01:48:08,668 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14636 1.5 0.2 5507280 547404 ? Sl 00:42 1:02 | \_ h2oai-run_test_test_scoring_binary_1_xgboostgbm_ 2021-08-20 01:48:08,670 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14641 1.3 0.2 5431980 535648 ? Sl 00:42 0:51 | \_ h2oai-run_test_test_scoring_binary_1_xgboostgbmdask_ 2021-08-20 01:48:08,672 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 17183 0.0 0.0 13312 3068 ? S 01:27 0:00 | | \_ /bin/sh -c set -eox ; cd /h2oai/tmp/h2oai/test_scoring_sagamoba; rm -rf scoring-pipeline && unzip -o scorer.zip && if [ -d scoring-package ]; then mv scoring-package scoring-pipeline; fi && cd scoring-pipeline && cat run_example.sh | sed 's/python3.6 --system-site-packages --never-download/python3.6 --system-site-packages --never-download --copies --app-data env_app_data_dir --setuptools embed --pip embed --wheel/g' > run_server_install.sh ; PMVAR=conda PYTHONPATH=. bash run_server_install.sh && rm -f run_server_install.sh 2021-08-20 01:48:08,674 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 13090 40.5 0.0 122900 99424 ? S 01:45 1:12 | | \_ /h2oai/tmp/h2oai/test_scoring_sagamoba/scoring-pipeline/env/bin/python3.8 -m pip install --use-deprecated=legacy-resolver -r requirements_for_pip.txt --no-cache-dir --upgrade --upgrade-strategy only-if-needed -c req_constraints_deps.txt -f https://download.pytorch.org/whl/torch_stable.html 2021-08-20 01:48:08,676 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14649 1.5 0.2 5433588 536492 ? Sl 00:42 1:00 | \_ h2oai-run_test_check_preds_ 2021-08-20 01:48:08,678 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14657 1.8 0.2 5443496 549080 ? Sl 00:42 1:13 | \_ h2oai-run_test_test_scoring_twosigma_bert_ 2021-08-20 01:48:08,680 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14661 1.4 0.2 5368348 536612 ? Sl 00:42 0:57 | \_ h2oai-run_test_test_mojo_jigsawtoxic_bert_ 2021-08-20 01:48:08,682 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14677 1.1 0.2 5431264 533576 ? Sl 00:42 0:46 | \_ h2oai-run_test_check_preds_ 2021-08-20 01:48:08,684 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14690 0.5 0.1 5356948 524904 ? Sl 00:42 0:23 | \_ /opt/h2oai/dai/python/bin/python -u -c import sys;exec(eval(sys.stdin.readline())) 2021-08-20 01:48:08,686 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14697 0.6 0.1 5357012 524160 ? Sl 00:42 0:25 | \_ /opt/h2oai/dai/python/bin/python -u -c import sys;exec(eval(sys.stdin.readline())) 2021-08-20 01:48:08,688 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14702 0.6 0.1 5357016 525408 ? Sl 00:42 0:24 | \_ /opt/h2oai/dai/python/bin/python -u -c import sys;exec(eval(sys.stdin.readline())) 2021-08-20 01:48:08,690 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 14708 0.6 0.1 5356972 525628 ? Sl 00:42 0:24 | \_ /opt/h2oai/dai/python/bin/python -u -c import sys;exec(eval(sys.stdin.readline())) 2021-08-20 01:48:08,692 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 22804 4.8 0.0 68208 42188 ? Sl 00:27 3:52 \_ ./minio server --address 127.0.0.1:9001 /h2oai/minio-data 2021-08-20 01:48:08,694 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39217 0.2 0.1 3131808 361512 ? S 00:35 0:08 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=84) --multiprocessing-fork 2021-08-20 01:48:08,696 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39222 0.1 0.1 3131816 361716 ? S 00:35 0:08 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=71) --multiprocessing-fork 2021-08-20 01:48:08,698 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39239 0.2 0.1 3131820 361516 ? S 00:35 0:08 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=84) --multiprocessing-fork 2021-08-20 01:48:08,700 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39270 0.2 0.1 3131824 361836 ? S 00:35 0:09 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=100) --multiprocessing-fork 2021-08-20 01:48:08,702 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39278 0.2 0.1 3131816 361068 ? S 00:35 0:09 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=80) --multiprocessing-fork 2021-08-20 01:48:08,704 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39281 0.2 0.1 3131620 360740 ? S 00:35 0:09 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=95) --multiprocessing-fork 2021-08-20 01:48:08,706 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39284 0.2 0.1 3131840 359984 ? S 00:35 0:09 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=83) --multiprocessing-fork 2021-08-20 01:48:08,708 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39286 0.2 0.1 3131824 360720 ? S 00:35 0:09 \_ _/opt/h2oai/dai/python/bin/python -s -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=38, pipe_handle=109) --multiprocessing-fork 2021-08-20 01:48:08,710 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 39723 0.0 0.1 4481672 330940 ? S 00:35 0:00 \_ _h2oai-DAI-worker_NODE:REMOTE2:stats 2021-08-20 01:48:08,712 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 9916 6.4 0.2 4761740 622596 ? Sl 00:40 4:21 \_ h2oai-DriverlessAI 2021-08-20 01:48:08,714 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 10640 2.0 0.0 280356 134216 ? Sl 00:41 1:22 \_ dask-scheduler [tcp://192.168.254.3:8786] 2021-08-20 01:48:08,716 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 10641 2.1 0.0 1646868 198644 ? Sl 00:41 1:27 \_ dask-scheduler [tcp://192.168.254.3:8790] 2021-08-20 01:48:08,718 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 10720 0.6 0.1 4328776 340536 ? S 00:41 0:25 \_ h2oai-DriverlessAI 2021-08-20 01:48:08,720 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 10721 0.0 0.1 4327148 341660 ? S 00:41 0:00 \_ h2oai-DriverlessAI 2021-08-20 01:48:08,722 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 11439 6.0 0.2 5033728 586268 ? Sl 00:41 4:00 \_ h2oai-DAI-worker_NODE:REMOTE1:stats 2021-08-20 01:48:08,724 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 11440 5.7 0.2 5174736 588904 ? Sl 00:41 3:50 \_ h2oai-DAI-worker_NODE:LOCAL2:stats 2021-08-20 01:48:08,726 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12253 1.6 0.0 366896 94844 ? Sl 00:42 1:03 \_ /opt/h2oai/dai/python/bin/python /opt/h2oai/dai/python/bin/dask-worker tcp://192.168.254.3:8786 --pid-file ./tmp/dai_dask_worker_n_jobs_2021-08-20_00_42_01.394918.pid --nthreads 1 --nprocs 1 --protocol tcp --resources n_jobs=1 --local-directory ./tmp/dask_worker_files --memory-limit 0.95 2021-08-20 01:48:08,728 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12441 0.0 0.0 26984 12172 ? S 00:42 0:00 | \_ /opt/h2oai/dai/python/bin/python -s -c from multiprocessing.resource_tracker import main;main(15) 2021-08-20 01:48:08,730 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12443 2.6 0.0 594460 117436 ? Sl 00:42 1:46 | \_ dask-worker [tcp://192.168.254.3:39180] 2021-08-20 01:48:08,732 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12254 2.5 0.1 2705032 319840 ? Sl 00:42 1:41 \_ /opt/h2oai/dai/python/bin/python /opt/h2oai/dai/python/bin/dask-cuda-worker tcp://192.168.254.3:8790 --pid-file ./tmp/dai_dask_cuda_worker_n_jobs_2021-08-20_00_42_01.395332.pid --nthreads 1 --resources n_gpus=1 n_jobs=1 --local-directory ./tmp/dask_cuda_worker_files --memory-limit 0.95 2021-08-20 01:48:08,734 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12599 0.0 0.0 26984 12124 ? S 00:42 0:00 \_ /opt/h2oai/dai/python/bin/python -s -c from multiprocessing.resource_tracker import main;main(16) 2021-08-20 01:48:08,736 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12601 3.1 0.2 17771452 742308 ? Sl 00:42 2:04 \_ dask-worker [tcp://192.168.254.3:45687] 2021-08-20 01:48:08,738 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2117 12603 3.3 0.2 17775668 741380 ? Sl 00:42 2:10 \_ dask-worker [tcp://192.168.254.3:38537] 2021-08-20 01:48:08,740 C: 15% D:935.6GB M:250.0GB NODE:LOCAL1 7646 DATA | 2021-08-20 01:48:09,296 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | jupyter-n 6073 2121 5u IPv4 146437 0t0 TCP *:8888 (LISTEN) 2021-08-20 01:48:09,302 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | redis-ser 6365 2121 6u IPv4 98137 0t0 TCP *:6379 (LISTEN) 2021-08-20 01:48:09,304 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | java 6366 2121 14u IPv4 128383 0t0 TCP 127.0.0.1:12348 (LISTEN) 2021-08-20 01:48:09,306 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | java 6366 2121 15u IPv4 128382 0t0 TCP 127.0.0.1:12349 (LISTEN) 2021-08-20 01:48:09,307 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | java 6367 2121 5u IPv4 128366 0t0 TCP 127.0.0.1:12346 (LISTEN) 2021-08-20 01:48:09,309 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | procsy 6371 2121 3u IPv4 146434 0t0 TCP 127.0.0.1:12347 (LISTEN) 2021-08-20 01:48:09,311 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | h2oai-Dri 6378 2121 14u IPv4 95180 0t0 TCP *:12345 (LISTEN) 2021-08-20 01:48:09,312 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | h2oai-Dri 6378 2121 16u IPv6 95181 0t0 TCP *:12345 (LISTEN) 2021-08-20 01:48:09,314 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | h2oai-Dri 7646 2121 14u IPv4 95180 0t0 TCP *:12345 (LISTEN) 2021-08-20 01:48:09,315 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | h2oai-Dri 7646 2121 16u IPv6 95181 0t0 TCP *:12345 (LISTEN) 2021-08-20 01:48:09,317 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | h2oai-Dri 7647 2121 14u IPv4 95180 0t0 TCP *:12345 (LISTEN) 2021-08-20 01:48:09,319 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | h2oai-Dri 7647 2121 16u IPv6 95181 0t0 TCP *:12345 (LISTEN) 2021-08-20 01:48:09,320 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | java 7716 2121 15u IPv4 128629 0t0 TCP 127.0.0.1:50361 (LISTEN) 2021-08-20 01:48:09,322 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | java 7716 2121 16u IPv4 128625 0t0 TCP 127.0.0.1:50362 (LISTEN) 2021-08-20 01:48:09,324 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 DATA | 2021-08-20 01:48:09,325 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:09,327 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Number of features created: 31 2021-08-20 01:48:09,329 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Number of model and feature tuning iterations: 5 2021-08-20 01:48:09,331 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Number of feature evolution iterations: 9 2021-08-20 01:48:09,333 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Number of models trained 2021-08-20 01:48:09,335 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Backend tuning: 1 2021-08-20 01:48:09,337 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Target transform tuning: 18 2021-08-20 01:48:09,339 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Model and feature tuning: 42 2021-08-20 01:48:09,341 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Feature pre-pruning: 6 2021-08-20 01:48:09,343 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Feature evolution: 222 2021-08-20 01:48:09,345 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Final pipeline: 3 2021-08-20 01:48:09,346 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:09,373 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Experiment: buvobamu (59939c96-0150-11ec-a7e1-0242c0a8fe02) 2021-08-20 01:48:09,377 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Version: 1.10.0, 2021-08-20 01:48 2021-08-20 01:48:09,380 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Settings: 7/2/8, seed=1037348886, GPUs enabled 2021-08-20 01:48:09,383 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Train data: [XXXXX] (1000, 11) 2021-08-20 01:48:09,387 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Validation data: N/A 2021-08-20 01:48:09,390 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Test data: N/A 2021-08-20 01:48:09,393 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Target column: [XXXXX] (regression, identity_noclip-transformed) 2021-08-20 01:48:09,396 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | System specs: Docker/Linux, 252 GB, 40 CPU cores, 2/2 GPUs 2021-08-20 01:48:09,399 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Max memory usage: 0.849 GB, 0.279 GB GPU 2021-08-20 01:48:09,401 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Recipe: AutoDL (16 iterations, 8 individuals) 2021-08-20 01:48:09,404 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Validation scheme: random, 6 internal holdouts (3-fold CV) 2021-08-20 01:48:09,407 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Feature engineering: 31 features scored (10 selected) 2021-08-20 01:48:09,410 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Timing: MOJO latency 0.0571 millis (512.7kB), Python latency 110.0896 millis (1.1GB) 2021-08-20 01:48:09,413 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Data preparation: 310.14 secs 2021-08-20 01:48:09,415 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Shift/Leakage detection: 30.75 secs 2021-08-20 01:48:09,418 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Model and feature tuning: 1027.26 secs (61 of 66 models trained) 2021-08-20 01:48:09,420 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Feature evolution: 2102.52 secs (222 of 528 models trained) 2021-08-20 01:48:09,424 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Final pipeline training: 17.77 secs (3 models trained) 2021-08-20 01:48:09,426 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Python / MOJO scorer building: 49.86 secs / 19.75 secs 2021-08-20 01:48:09,429 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Validation score: RMSE = 5.002508 (constant preds of 14.35) 2021-08-20 01:48:09,431 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Validation score: RMSE = 1.638517 +/- 0.04910973 (baseline) 2021-08-20 01:48:09,434 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Validation score: RMSE = 1.543872 +/- 0.04469455 (final pipeline) 2021-08-20 01:48:09,436 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Test score: RMSE = N/A 2021-08-20 01:48:09,439 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:09,441 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:09,444 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Final validation scores (internal holdout, bootstrap on folds) +/- stddev: 2021-08-20 01:48:09,446 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | optimized: RMSE = 1.543872 +/- 0.04469455 (less is better) 2021-08-20 01:48:09,448 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | GINI = 0.9528597 +/- 0.001413133 (more is better) 2021-08-20 01:48:09,451 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | MAE = 1.148299 +/- 0.02813014 (less is better) 2021-08-20 01:48:09,453 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | MAPE = 10.06 +/- 0.5666763 (less is better) 2021-08-20 01:48:09,456 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | MER = 6.50539 +/- 0.4109592 (less is better) 2021-08-20 01:48:09,458 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | MSE = 2.385539 +/- 0.1371758 (less is better) 2021-08-20 01:48:09,460 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | R2 = 0.9050291 +/- 0.00353755 (more is better) 2021-08-20 01:48:09,463 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | R2COD = 0.9047411 +/- 0.00371669 (more is better) 2021-08-20 01:48:09,465 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | RMSLE = 3.333333e+35 +/- 4.714045e+35 (less is better) 2021-08-20 01:48:09,468 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | RMSPE = 19.72355 +/- 3.711674 (less is better) 2021-08-20 01:48:09,470 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | SMAPE = 9.3278 +/- 0.2146766 (less is better) 2021-08-20 01:48:09,472 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:48:09,475 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Collecting logs 2021-08-20 01:48:09,506 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Archiving experiment summary to ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/h2oai_experiment_summary_59939c96-0150-11ec-a7e1-0242c0a8fe02.zip 2021-08-20 01:48:09,547 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Archiving logs to ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/h2oai_experiment_logs_59939c96-0150-11ec-a7e1-0242c0a8fe02.zip 2021-08-20 01:48:09,565 C: 14% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Deleting temporary files 2021-08-20 01:48:10,388 C: 14% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Returning from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02 after 3.56e+03 seconds. 2021-08-20 01:48:10,941 C: 14% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | AutoReport incoming data dir: None 2021-08-20 01:48:14,630 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Creating report directory ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51 2021-08-20 01:48:14,640 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Creating images directory ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images 2021-08-20 01:48:14,642 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Creating styles directory ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/style 2021-08-20 01:48:14,729 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Version Info 2021-08-20 01:48:14,739 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Experiment Overview 2021-08-20 01:48:14,848 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Saving train data summary to ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/train_data_summary.csv 2021-08-20 01:48:15,205 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Data Information 2021-08-20 01:48:15,208 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Validation Scheme 2021-08-20 01:48:15,333 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Model Tuning Information 2021-08-20 01:48:15,429 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Feature Evolution Information 2021-08-20 01:48:15,440 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Final Features 2021-08-20 01:48:15,952 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Getting Final Model Information 2021-08-20 01:48:16,981 C: 17% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Alternative Models 2021-08-20 01:48:17,261 C: 17% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Partial Dependence and ICE Information 2021-08-20 01:48:17,264 C: 17% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Shapley Values 2021-08-20 01:48:17,267 C: 17% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Model Interpretability info 2021-08-20 01:48:17,270 C: 17% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Getting Internal Parameters 2021-08-20 01:48:18,353 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.template (1/48) 2021-08-20 01:48:18,362 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.template (1/48) 2021-08-20 01:48:18,392 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Intro (2/48) 2021-08-20 01:48:18,396 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Intro (2/48) 2021-08-20 01:48:18,574 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Performance (3/48) 2021-08-20 01:48:18,577 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Performance (3/48) 2021-08-20 01:48:18,688 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Settings (4/48) 2021-08-20 01:48:18,691 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Settings (4/48) 2021-08-20 01:48:18,740 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Specification (5/48) 2021-08-20 01:48:18,743 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Specification (5/48) 2021-08-20 01:48:18,853 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Versions (6/48) 2021-08-20 01:48:18,856 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Experiment Overview.Versions (6/48) 2021-08-20 01:48:18,914 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.template (7/48) 2021-08-20 01:48:18,916 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.template (7/48) 2021-08-20 01:48:18,935 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.Intro (8/48) 2021-08-20 01:48:18,938 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.Intro (8/48) 2021-08-20 01:48:19,006 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.Training (9/48) 2021-08-20 01:48:19,008 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.Training (9/48) 2021-08-20 01:48:19,096 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.Shift (10/48) 2021-08-20 01:48:19,099 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Data Overview.Shift (10/48) 2021-08-20 01:48:19,162 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.template (11/48) 2021-08-20 01:48:19,164 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.template (11/48) 2021-08-20 01:48:19,182 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Intro (12/48) 2021-08-20 01:48:19,185 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Intro (12/48) 2021-08-20 01:48:19,220 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Assumptions (13/48) 2021-08-20 01:48:19,223 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Assumptions (13/48) 2021-08-20 01:48:19,267 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Pipeline (14/48) 2021-08-20 01:48:19,269 C: 16% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Pipeline (14/48) 2021-08-20 01:48:19,431 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Settings (15/48) 2021-08-20 01:48:19,438 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Methodology.Settings (15/48) 2021-08-20 01:48:19,541 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Data Sampling.template (16/48) 2021-08-20 01:48:19,544 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Data Sampling.template (16/48) 2021-08-20 01:48:19,592 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Validation Strategy.template (17/48) 2021-08-20 01:48:19,595 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Validation Strategy.template (17/48) 2021-08-20 01:48:19,611 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Skipped section Validation Strategy.DAI Recipe Validation (18/48) 2021-08-20 01:48:19,614 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Skipped section Validation Strategy.DAI Time Series Validation (19/48) 2021-08-20 01:48:19,616 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Validation Strategy.DAI Fold Information (20/48) 2021-08-20 01:48:19,618 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Validation Strategy.DAI Fold Information (20/48) 2021-08-20 01:48:19,663 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Model Tuning.template (21/48) 2021-08-20 01:48:19,665 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Model Tuning.template (21/48) 2021-08-20 01:48:19,732 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Evolution.template (22/48) 2021-08-20 01:48:19,735 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Evolution.template (22/48) 2021-08-20 01:48:19,770 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.template (23/48) 2021-08-20 01:48:19,773 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.template (23/48) 2021-08-20 01:48:19,787 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.Intro (24/48) 2021-08-20 01:48:19,789 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.Intro (24/48) 2021-08-20 01:48:19,831 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.Feature Importance (25/48) 2021-08-20 01:48:19,834 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.Feature Importance (25/48) 2021-08-20 01:48:20,399 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.Permutation Feature Importance (26/48) 2021-08-20 01:48:20,402 C: 15% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.Permutation Feature Importance (26/48) 2021-08-20 01:48:20,449 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section NLP.DAI NLP Detail (27/48) 2021-08-20 01:48:20,455 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section NLP.DAI NLP Detail (27/48) 2021-08-20 01:48:20,506 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.DAI Monotonicity Constraints (28/48) 2021-08-20 01:48:20,508 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Feature Transformations.DAI Monotonicity Constraints (28/48) 2021-08-20 01:48:20,541 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.template (29/48) 2021-08-20 01:48:20,543 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.template (29/48) 2021-08-20 01:48:20,563 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Image Processing.template (30/48) 2021-08-20 01:48:20,565 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Image Processing.template (30/48) 2021-08-20 01:48:20,596 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Pipeline (31/48) 2021-08-20 01:48:20,598 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Pipeline (31/48) 2021-08-20 01:48:20,618 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Pipeline Overview (32/48) 2021-08-20 01:48:20,620 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Pipeline Overview (32/48) 2021-08-20 01:48:20,659 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Performance (33/48) 2021-08-20 01:48:20,661 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Performance (33/48) 2021-08-20 01:48:20,733 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.GLM (34/48) 2021-08-20 01:48:20,740 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.GLM (34/48) 2021-08-20 01:48:20,788 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.PSI (35/48) 2021-08-20 01:48:20,790 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.PSI (35/48) 2021-08-20 01:48:20,830 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Prediction Statistics (36/48) 2021-08-20 01:48:20,832 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Prediction Statistics (36/48) 2021-08-20 01:48:20,861 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Response Rates (37/48) 2021-08-20 01:48:20,864 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Response Rates (37/48) 2021-08-20 01:48:20,906 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Additional Performance (38/48) 2021-08-20 01:48:20,909 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Final Model.Additional Performance (38/48) 2021-08-20 01:48:20,966 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Alternative Models.template (39/48) 2021-08-20 01:48:20,968 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Alternative Models.template (39/48) 2021-08-20 01:48:21,030 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Deployment.template (40/48) 2021-08-20 01:48:21,032 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Deployment.template (40/48) 2021-08-20 01:48:21,068 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Partial Dependence Plots.template (41/48) 2021-08-20 01:48:21,070 C: 14% D:935.5GB M:250.4GB NODE:LOCAL1 7646 INFO | Rendering section Partial Dependence Plots.template (41/48) 2021-08-20 01:48:21,540 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Reading None data from: ./tmp/n/61efab2a-ef06-11eb-aeb8-0242c0a8fe03/Friedman1-results.csv.1627409626.1267896.bin 2021-08-20 01:48:21,546 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Successfully imported datatable binary file. 2021-08-20 01:48:21,548 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Data shape: (1000, 11) 2021-08-20 01:48:21,550 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Data size: 0.09 MiB 2021-08-20 01:48:21,551 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Time to read the None dataset with datatable: 0.008293152 2021-08-20 01:48:21,955 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.0 -> X_0 2021-08-20 01:48:21,957 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.1 -> X_1 2021-08-20 01:48:21,959 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.2 -> X_2 2021-08-20 01:48:21,960 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.3 -> X_3 2021-08-20 01:48:21,962 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.4 -> X_4 2021-08-20 01:48:21,963 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.5 -> X_5 2021-08-20 01:48:21,965 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.6 -> X_6 2021-08-20 01:48:21,967 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.7 -> X_7 2021-08-20 01:48:21,969 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.8 -> X_8 2021-08-20 01:48:21,971 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.9 -> X_9 2021-08-20 01:48:22,072 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-08-20 01:48:22,100 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-08-20 01:48:22,153 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-08-20 01:48:22,158 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:22,197 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:22,223 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-08-20 01:48:22,244 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:22,321 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:22,473 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:22,481 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:22,504 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:22,506 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:22,510 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:22,513 C: 19% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:22,560 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:22,569 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:22,611 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:22,628 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:22,633 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:22,684 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:22,755 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.27673 seconds. 2021-08-20 01:48:22,757 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.51535 seconds. 2021-08-20 01:48:22,769 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.26033 seconds. 2021-08-20 01:48:22,771 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.57590 seconds. 2021-08-20 01:48:22,790 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.27979 seconds. 2021-08-20 01:48:22,792 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.63748 seconds. 2021-08-20 01:48:22,846 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.28000 seconds. 2021-08-20 01:48:22,848 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.52940 seconds. 2021-08-20 01:48:22,928 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:22,976 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:22,984 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:23,041 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:23,105 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,112 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,201 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,207 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,230 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,236 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,245 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,251 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,265 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:23,318 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:23,352 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:23,359 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:23,439 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.32873 seconds. 2021-08-20 01:48:23,443 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.51544 seconds. 2021-08-20 01:48:23,462 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.25523 seconds. 2021-08-20 01:48:23,465 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.48174 seconds. 2021-08-20 01:48:23,493 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.24282 seconds. 2021-08-20 01:48:23,495 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.25957 seconds. 2021-08-20 01:48:23,497 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.45833 seconds. 2021-08-20 01:48:23,499 C: 28% D:935.5GB M:249.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.52205 seconds. 2021-08-20 01:48:23,580 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:23,629 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:23,646 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:23,701 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:23,788 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,795 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,803 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,810 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,831 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,837 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:23,911 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:48:23,922 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:48:23,970 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:48:23,989 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:23,995 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:24,083 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.28936 seconds. 2021-08-20 01:48:24,086 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.50722 seconds. 2021-08-20 01:48:24,100 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.29142 seconds. 2021-08-20 01:48:24,104 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.47476 seconds. 2021-08-20 01:48:24,106 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:48:24,135 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.29932 seconds. 2021-08-20 01:48:24,139 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.49462 seconds. 2021-08-20 01:48:24,255 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.26098 seconds. 2021-08-20 01:48:24,257 C: 36% D:935.5GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.55787 seconds. 2021-08-20 01:48:24,700 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-08-20 01:48:24,783 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:24,879 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-08-20 01:48:24,983 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:25,002 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:25,011 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:25,146 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:25,226 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:25,232 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:25,292 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.28441 seconds. 2021-08-20 01:48:25,294 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.51321 seconds. 2021-08-20 01:48:25,359 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:25,454 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:25,519 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.28826 seconds. 2021-08-20 01:48:25,521 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.54048 seconds. 2021-08-20 01:48:25,636 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:25,645 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:25,699 C: 28% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:25,780 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:25,943 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:25,952 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:25,958 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.31566 seconds. 2021-08-20 01:48:25,961 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.50843 seconds. 2021-08-20 01:48:26,102 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:26,112 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 500 iterations: 500 2021-08-20 01:48:26,299 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.35006 seconds. 2021-08-20 01:48:26,303 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.60437 seconds. 2021-08-20 01:48:26,352 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:26,360 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:26,456 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) start. 2021-08-20 01:48:26,487 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:48:26,614 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.25679 seconds. 2021-08-20 01:48:26,617 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.51658 seconds. 2021-08-20 01:48:26,644 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:26,650 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) start. 2021-08-20 01:48:26,771 C: 24% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 473 iterations: 473 2021-08-20 01:48:26,922 C: 28% D:935.5GB M:250.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (16000, 10) model predict (16000, 10) end. Took 0.27296 seconds. 2021-08-20 01:48:26,931 C: 28% D:935.5GB M:250.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (16000, 6) end. Took 0.47169 seconds. 2021-08-20 01:48:27,780 C: 28% D:935.5GB M:250.0GB NODE:LOCAL1 7646 INFO | PDP pool finished after 6.607781410217285 seconds, remaining 38.392218589782715 seconds. 2021-08-20 01:48:27,923 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Loading ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxx_xxx_X_5.xxxx 2021-08-20 01:48:27,929 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Loading <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/pdp_dai_X_3.json>>> 2021-08-20 01:48:27,951 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Creating ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxxxxxxxxx_xxxx_xxx_55x55/xxxxxx/xxx_xxx_xxx_X_5.xxx plot. 2021-08-20 01:48:27,953 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Creating <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images/pdp_dai_ice_X_3.png>>> plot. 2021-08-20 01:48:28,150 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Reading None data from: ./tmp/n/61efab2a-ef06-11eb-aeb8-0242c0a8fe03/Friedman1-results.csv.1627409626.1267896.bin 2021-08-20 01:48:28,153 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Successfully imported datatable binary file. 2021-08-20 01:48:28,155 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Data shape: (1000, 11) 2021-08-20 01:48:28,158 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Data size: 0.09 MiB 2021-08-20 01:48:28,160 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 INFO | Time to read the None dataset with datatable: 0.007727623 2021-08-20 01:48:28,523 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.0 -> X_0 2021-08-20 01:48:28,525 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.1 -> X_1 2021-08-20 01:48:28,527 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.2 -> X_2 2021-08-20 01:48:28,529 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.3 -> X_3 2021-08-20 01:48:28,531 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.4 -> X_4 2021-08-20 01:48:28,533 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.5 -> X_5 2021-08-20 01:48:28,535 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.6 -> X_6 2021-08-20 01:48:28,537 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.7 -> X_7 2021-08-20 01:48:28,539 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.8 -> X_8 2021-08-20 01:48:28,541 C: 16% D:935.5GB M:250.3GB NODE:LOCAL1 7646 DATA | Sanitized: X.9 -> X_9 2021-08-20 01:48:29,441 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Loading ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxx_xxx_X_0.xxxx 2021-08-20 01:48:29,450 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 DATA | Loading <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/pdp_dai_X_0.json>>> 2021-08-20 01:48:29,462 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Creating ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxxxxxxxxx_xxxx_xxx_55x55/xxxxxx/xxx_xxx_xxx_X_0.xxx plot. 2021-08-20 01:48:29,465 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 DATA | Creating <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images/pdp_dai_ice_X_0.png>>> plot. 2021-08-20 01:48:30,541 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Loading ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxx_xxx_X_5.xxxx 2021-08-20 01:48:30,550 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 DATA | Loading <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/pdp_dai_X_1.json>>> 2021-08-20 01:48:30,559 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Creating ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxxxxxxxxx_xxxx_xxx_55x55/xxxxxx/xxx_xxx_xxx_X_5.xxx plot. 2021-08-20 01:48:30,561 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 DATA | Creating <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images/pdp_dai_ice_X_1.png>>> plot. 2021-08-20 01:48:31,445 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Loading ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxx_xxx_X_5.xxxx 2021-08-20 01:48:31,447 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 DATA | Loading <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/pdp_dai_X_4.json>>> 2021-08-20 01:48:31,463 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 INFO | Creating ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxxxxxxxxx_xxxx_xxx_55x55/xxxxxx/xxx_xxx_xxx_X_5.xxx plot. 2021-08-20 01:48:31,465 C: 12% D:935.5GB M:250.2GB NODE:LOCAL1 7646 DATA | Creating <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images/pdp_dai_ice_X_4.png>>> plot. 2021-08-20 01:48:32,408 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Loading ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxx_xxx_X_5.xxxx 2021-08-20 01:48:32,417 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 DATA | Loading <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/pdp_dai_X_2.json>>> 2021-08-20 01:48:32,430 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Creating ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxxxxxxxxx_xxxx_xxx_55x55/xxxxxx/xxx_xxx_xxx_X_5.xxx plot. 2021-08-20 01:48:32,432 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 DATA | Creating <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images/pdp_dai_ice_X_2.png>>> plot. 2021-08-20 01:48:33,383 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Loading ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxx_xxx_X_5.xxxx 2021-08-20 01:48:33,385 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 DATA | Loading <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/pdp_dai_X_7.json>>> 2021-08-20 01:48:33,401 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 INFO | Creating ./xxx/x/x5xxx_xxxxxxxxxx_55555x55-0550-55xx-x5x5-0555x0x5xx05/xxxxxxxxxx_xxxx_xxx_55x55/xxxxxx/xxx_xxx_xxx_X_5.xxx plot. 2021-08-20 01:48:33,403 C: 15% D:935.5GB M:250.1GB NODE:LOCAL1 7646 DATA | Creating <<<./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/autoreport_temp_dir_94d51/images/pdp_dai_ice_X_7.png>>> plot. 2021-08-20 01:48:34,642 C: 14% D:935.2GB M:250.5GB NODE:LOCAL1 7646 INFO | Rendering section MLI.Shapley Contributions (42/48) 2021-08-20 01:48:34,650 C: 14% D:935.2GB M:250.5GB NODE:LOCAL1 7646 INFO | Rendering section MLI.Shapley Contributions (42/48) 2021-08-20 01:48:35,352 C: 14% D:935.2GB M:250.5GB NODE:LOCAL1 7646 INFO | When columns are included, they will be sanitized. 2021-08-20 01:48:35,358 C: 14% D:935.2GB M:250.5GB NODE:LOCAL1 7646 INFO | Loading fitted model from ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/fitted_model.pickle 2021-08-20 01:48:35,645 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Loaded fitted model in 0.2865555 secs 2021-08-20 01:48:35,655 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Successfully imported datatable binary file. 2021-08-20 01:48:35,657 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Actual target values in test set - will be ignored during scoring. 2021-08-20 01:48:35,660 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Prepared test set in 0.01323676 secs 2021-08-20 01:48:35,662 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Sanitize column names (as during training) 2021-08-20 01:48:35,673 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Making test set predictions with output_margin=False and pred_contribs=True and pred_contribs_original=True and enable_mojo=True 2021-08-20 01:48:35,680 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Not using MOJO for predictions since pred_contribs_original not yet implemented. 2021-08-20 01:48:35,788 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1000, 6) start. 2021-08-20 01:48:36,039 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-08-20 01:48:36,046 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1000, 10) model predict Shapley (1000, 10) start. 2021-08-20 01:48:36,168 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 50 iterations: 500 2021-08-20 01:48:36,201 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (1000, 10) model predict Shapley (1000, 10) end. Took 0.15734 seconds. 2021-08-20 01:48:36,203 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform Shapley (1000, 6) end. Took 0.42227 seconds. 2021-08-20 01:48:36,293 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Made test set predictions in 0.6322176 secs 2021-08-20 01:48:36,297 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Prediction shape: (1000, 11) 2021-08-20 01:48:36,300 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Writing csv test set predictions to ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02-autoreport-tmp-fe4ae5b4-5/autoreport_shap_contribs_59939c96-0150-11ec-a7e1-0242c0a8fe02.csv 2021-08-20 01:48:36,305 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Saved test set predictions in 0.01386261 secs 2021-08-20 01:48:36,402 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Datatable dt.options.nthreads = 4 2021-08-20 01:48:36,406 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Datatable separator = AUTO 2021-08-20 01:48:36,410 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [*] Process input parameters 2021-08-20 01:48:36,413 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Using default 4 thread(s) 2021-08-20 01:48:36,417 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | fill = True (incomplete lines will be padded with NAs) 2021-08-20 01:48:36,420 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | na_strings = ["", "?", "None", "nan", "NA", "N/A", "unknown", "inf", "-inf", "1.7976931348623157e+308", "-1.7976931348623157e+308"] 2021-08-20 01:48:36,423 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | + some na strings look like numbers 2021-08-20 01:48:36,426 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | + empty string is considered an NA 2021-08-20 01:48:36,429 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | strip_whitespace = True 2021-08-20 01:48:36,432 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | skip_blank_lines = False 2021-08-20 01:48:36,435 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Input is assumed to be a file name. 2021-08-20 01:48:36,438 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | File "./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02-autoreport-tmp-fe4ae5b4-5/autoreport_shap_contribs_59939c96-0150-11ec-a7e1-0242c0a8fe02.csv" opened, size: 92173 2021-08-20 01:48:36,441 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [1] Prepare for reading 2021-08-20 01:48:36,444 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | ==== file sample ==== 2021-08-20 01:48:36,446 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | aaaaaaa_A_0,aaaaaaa_A_1,aaaaaaa_A_1,aaaaaaa_A_1,aaaaaaa_A_1,aaaaaaa_A_1,aaaaaaa_A_1,aaaaaaa_A_1,a... 2021-08-20 01:48:36,449 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | -0.11111111,-1.111011,-0.11111001,1.0111001,-0.101111,0.0,0.0,0.001011111,0.0,0.0,11.111111 2021-08-20 01:48:36,452 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | 1.1111111,1.1111111,0.11111011,1.1111111,0.11111111,0.0,0.0,0.011101011,0.0,0.0,11.111111 2021-08-20 01:48:36,454 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | 1.1111111,1.1111111,-0.11101111,1.111111,0.1111111,0.0,0.0,0.011111101,0.0,0.0,11.111111 2021-08-20 01:48:36,457 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | 1.1101111,1.1111111,0.1111111,-0.11111101,-0.1111011,0.0,0.0,0.011101011,0.0,0.0,11.111111 2021-08-20 01:48:36,459 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | ===================== 2021-08-20 01:48:36,462 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | LF character (\n) found in input, \r-only newlines will be prohibited 2021-08-20 01:48:36,464 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [2] Detect parse settings 2021-08-20 01:48:36,467 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | sep=',' with 100 lines of 11 fields using quote rule 0 2021-08-20 01:48:36,470 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Detected 11 columns 2021-08-20 01:48:36,473 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Quote rule = 0 2021-08-20 01:48:36,475 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | sep = ',' 2021-08-20 01:48:36,478 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [3] Detect column types and header 2021-08-20 01:48:36,480 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Number of sampling jump points = 1 because the first chunk was 10.0times smaller than the entire file 2021-08-20 01:48:36,482 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Type codes (jump 0): FFFFFFFFFFF 2021-08-20 01:48:36,485 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Type codes (final): FFFFFFFFFFF 2021-08-20 01:48:36,487 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | `header` determined to be True due to column 1 containing a string on row 1 and type Float64 in the rest of the sample 2021-08-20 01:48:36,489 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | ===== 2021-08-20 01:48:36,492 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Sampled 100 rows at 1 jump point(s) 2021-08-20 01:48:36,494 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Bytes from first data row to the end of last row: 92173 2021-08-20 01:48:36,496 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Line length: mean=91.95 sd=2.13 min=87 max=98 2021-08-20 01:48:36,499 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Estimated number of rows: 1003 2021-08-20 01:48:36,501 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Initial alloc = 1103 rows (using bytes/max(mean-2*sd,min) clamped between [1.1*estn, 2.0*estn]) 2021-08-20 01:48:36,503 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [4] Assign column names 2021-08-20 01:48:36,505 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [5] Apply user overrides on column types 2021-08-20 01:48:36,508 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Allocating 11 column slots with 1103 rows 2021-08-20 01:48:36,510 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [6] Read the data 2021-08-20 01:48:36,512 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Number of threads reduced to 1 because data is small 2021-08-20 01:48:36,514 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | The input will be read in 1 chunk of size 92040 each 2021-08-20 01:48:36,518 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | [7] Finalizing the frame 2021-08-20 01:48:36,520 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | ============================= 2021-08-20 01:48:36,523 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Read 1,000 rows x 11 columns from 90.0KB input in 00:00.062s 2021-08-20 01:48:36,525 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | = 0.003s ( 5%) memory-mapping input file 2021-08-20 01:48:36,527 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | + 0.013s (21%) detecting parse parameters 2021-08-20 01:48:36,530 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | + 0.028s (46%) detecting column types using 100 sample rows 2021-08-20 01:48:36,532 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | + 0.005s ( 7%) allocating [1,103 x 11] frame (96.6KB) of which 1,000 ( 91%) rows used 2021-08-20 01:48:36,534 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | + 0.008s (13%) reading data 2021-08-20 01:48:36,536 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | = 0.001s ( 2%) reading into row-major buffers 2021-08-20 01:48:36,539 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | = 0.000s ( 0%) saving into the output frame 2021-08-20 01:48:36,541 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | = 0.007s (11%) waiting 2021-08-20 01:48:36,543 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | = 0.002s ( 4%) creating the final Frame 2021-08-20 01:48:36,546 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Data of size (1000, 11) loaded successfully. Original features (values of first and last 5 rows): 2021-08-20 01:48:36,595 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 1: contrib_X_0 real [-0.45117226 1.5521353 1.6668166 1.2804896 0.59621376] ... [ 0.4307745 -0.8727725 1.5573666 1.6057643 -2.2325213] 2021-08-20 01:48:36,597 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 2: contrib_X_1 real [-1.219096 1.5777168 1.6827847 1.1625395 1.2931378] ... [-0.5465758 -1.6382928 1.5093836 1.5605004 -0.87767976] 2021-08-20 01:48:36,599 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 3: contrib_X_2 real [-0.54165006 0.46269023 -0.25609395 0.4535828 -0.5612354 ] ... [-0.42392665 0.69161946 0.709562 -0.25375918 0.64019716] 2021-08-20 01:48:36,601 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 4: contrib_X_3 real [ 1.0449002 1.8948191 2.249189 -0.59786403 -2.1741536 ] ... [ 2.3232512 1.8271065 -0.00288094 -2.0075476 2.4016333 ] 2021-08-20 01:48:36,603 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 5: contrib_X_4 real [-0.807274 0.54987836 0.9349587 -0.9187088 -0.955161 ] ... [ 0.7493322 -0.18105257 0.5858645 0.10786074 0.20431672] 2021-08-20 01:48:36,605 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 6: contrib_X_5 real [0. 0. 0. 0. 0.] ... [0. 0. 0. 0. 0.] 2021-08-20 01:48:36,607 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 7: contrib_X_6 real [0. 0. 0. 0. 0.] ... [0. 0. 0. 0. 0.] 2021-08-20 01:48:36,609 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 8: contrib_X_7 real [0.00502228 0.01640506 0.0196194 0.01640506 0.01640506] ... [ 0.00538169 0.00502228 0.01640506 -0.06127153 0.00502228] 2021-08-20 01:48:36,611 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 9: contrib_X_8 real [0. 0. 0. 0. 0.] ... [0. 0. 0. 0. 0.] 2021-08-20 01:48:36,612 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 10: contrib_X_9 real [0. 0. 0. 0. 0.] ... [0. 0. 0. 0. 0.] 2021-08-20 01:48:36,614 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 DATA | Feature 11: contrib_bias real [14.342934 14.342934 14.342934 14.342934 14.342934] ... [14.342934 14.342934 14.342934 14.342934 14.342934] 2021-08-20 01:48:36,616 C: 13% D:935.2GB M:249.9GB NODE:LOCAL1 7646 INFO | Successfully imported datatable binary file. 2021-08-20 01:48:37,184 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Skipped section GLM.template (43/48) 2021-08-20 01:48:37,192 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Skipped section MLI.Surrogate DT (44/48) 2021-08-20 01:48:37,194 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.template (45/48) 2021-08-20 01:48:37,196 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.template (45/48) 2021-08-20 01:48:37,297 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.PSI_Appendix (46/48) 2021-08-20 01:48:37,299 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.PSI_Appendix (46/48) 2021-08-20 01:48:37,347 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.Response_Rates_Appendix (47/48) 2021-08-20 01:48:37,349 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.Response_Rates_Appendix (47/48) 2021-08-20 01:48:37,393 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.NLP Appendix (48/48) 2021-08-20 01:48:37,395 C: 11% D:935.2GB M:250.1GB NODE:LOCAL1 7646 INFO | Rendering section Appendix.NLP Appendix (48/48) 2021-08-20 01:48:39,480 C: 45% D:935.1GB M:247.9GB NODE:LOCAL1 7646 INFO | Rendering Automatic Report 2021-08-20 01:48:39,508 C: 45% D:935.1GB M:247.9GB NODE:LOCAL1 7646 INFO | Updating ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/h2oai_experiment_summary_59939c96-0150-11ec-a7e1-0242c0a8fe02.zip inside ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/h2oai_experiment_logs_59939c96-0150-11ec-a7e1-0242c0a8fe02.zip 2021-08-20 01:48:39,510 C: 45% D:935.1GB M:247.9GB NODE:LOCAL1 7646 INFO | Archiving logs to ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/h2oai_experiment_logs_59939c96-0150-11ec-a7e1-0242c0a8fe02.zip 2021-09-15 20:08:50,968 C: 0% D:0B M:0B NODE:LOCAL1 38885 WARNING| MOJO pipeline already exists 2021-09-15 20:08:53,722 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:08:53,800 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:08:54,021 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:08:54,028 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:08:54,186 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:08:54,213 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.18671 seconds. 2021-09-15 20:08:54,215 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.41949 seconds. 2021-09-15 20:08:54,414 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:08:54,493 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:08:54,681 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:08:54,687 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:08:54,811 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:08:54,840 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.15428 seconds. 2021-09-15 20:08:54,842 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.35309 seconds. 2021-09-15 20:08:55,050 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:08:55,127 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:08:55,335 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:08:55,344 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:08:55,486 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:08:55,513 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.17332 seconds. 2021-09-15 20:08:55,516 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.39337 seconds. 2021-09-15 20:08:55,732 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:08:55,806 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:08:56,014 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:08:56,025 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:08:56,140 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:08:56,167 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.14840 seconds. 2021-09-15 20:08:56,170 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.36627 seconds. 2021-09-15 20:08:56,384 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:08:56,461 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:08:56,662 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:08:56,670 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:08:56,832 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:08:56,862 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.19467 seconds. 2021-09-15 20:08:56,865 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.40763 seconds. 2021-09-15 20:08:57,062 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:08:57,142 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:08:57,364 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:08:57,372 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:08:57,531 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:08:57,561 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.19270 seconds. 2021-09-15 20:08:57,563 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.42570 seconds. 2021-09-15 20:08:57,983 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 20:08:57,986 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 20:08:57,988 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 20:08:58,628 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.6340 seconds (0.6340 millis per row) 2021-09-15 20:12:41,467 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:12:41,562 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:41,770 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:41,776 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:41,900 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:42,114 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.33930 seconds. 2021-09-15 20:12:42,118 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.55913 seconds. 2021-09-15 20:12:42,308 C: 6% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:42,494 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:42,505 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:42,637 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:42,849 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.35022 seconds. 2021-09-15 20:12:42,851 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.55041 seconds. 2021-09-15 20:12:43,012 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:43,212 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:43,220 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:43,358 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:12:43,569 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.35145 seconds. 2021-09-15 20:12:43,579 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.56365 seconds. 2021-09-15 20:12:43,777 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:12:43,849 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:44,083 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:44,093 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:44,246 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:44,453 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36520 seconds. 2021-09-15 20:12:44,456 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.60973 seconds. 2021-09-15 20:12:44,598 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:44,784 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:44,790 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:44,918 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:45,114 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.32593 seconds. 2021-09-15 20:12:45,116 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.52109 seconds. 2021-09-15 20:12:45,261 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:45,436 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:45,444 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:45,547 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:12:45,727 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.28718 seconds. 2021-09-15 20:12:45,737 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.47168 seconds. 2021-09-15 20:12:45,914 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:12:45,992 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:46,207 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:46,214 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:46,347 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:46,582 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.37034 seconds. 2021-09-15 20:12:46,584 C: 12% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.59645 seconds. 2021-09-15 20:12:46,738 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:46,948 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:46,955 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:47,108 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:47,323 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36990 seconds. 2021-09-15 20:12:47,326 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.59358 seconds. 2021-09-15 20:12:47,486 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:47,666 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:47,674 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:47,815 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:12:48,010 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.33853 seconds. 2021-09-15 20:12:48,013 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.52948 seconds. 2021-09-15 20:12:48,215 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:12:48,294 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:48,493 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:48,501 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:48,653 C: 11% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:48,861 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36325 seconds. 2021-09-15 20:12:48,872 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.57168 seconds. 2021-09-15 20:12:49,001 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:49,211 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:49,218 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:49,354 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:49,561 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.34480 seconds. 2021-09-15 20:12:49,565 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.56575 seconds. 2021-09-15 20:12:49,736 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:49,938 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:49,948 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:50,114 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:12:50,319 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.37486 seconds. 2021-09-15 20:12:50,323 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.59012 seconds. 2021-09-15 20:12:50,524 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:12:50,621 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:50,836 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:50,845 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:50,991 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:51,201 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.35843 seconds. 2021-09-15 20:12:51,205 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.58662 seconds. 2021-09-15 20:12:51,370 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:51,583 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:51,590 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:51,718 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:51,923 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.33436 seconds. 2021-09-15 20:12:51,926 C: 9% D:1.1TB M:263.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.55778 seconds. 2021-09-15 20:12:52,083 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:52,278 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:52,284 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:52,414 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:12:52,604 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.32172 seconds. 2021-09-15 20:12:52,608 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.52799 seconds. 2021-09-15 20:12:52,811 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:12:52,894 C: 9% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:53,088 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:53,095 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:53,222 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:53,431 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.33729 seconds. 2021-09-15 20:12:53,434 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.54400 seconds. 2021-09-15 20:12:53,576 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:53,786 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:53,795 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:53,930 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:12:54,130 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.33806 seconds. 2021-09-15 20:12:54,140 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.56125 seconds. 2021-09-15 20:12:54,298 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:12:54,506 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:12:54,514 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:12:54,650 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:12:54,832 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.32101 seconds. 2021-09-15 20:12:54,834 C: 10% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.53909 seconds. 2021-09-15 20:12:55,264 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 20:12:55,275 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 20:12:55,277 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 20:12:55,850 C: 8% D:1.1TB M:263.4GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.5753 seconds (0.5753 millis per row) 2021-09-15 20:13:24,278 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:13:24,379 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:13:24,676 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:13:24,687 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:13:24,867 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:13:25,071 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38134 seconds. 2021-09-15 20:13:25,075 C: 97% D:1.1TB M:258.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.69727 seconds. 2021-09-15 20:13:25,291 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:13:25,624 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:13:25,631 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:13:25,821 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:13:26,024 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.39306 seconds. 2021-09-15 20:13:26,026 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.73915 seconds. 2021-09-15 20:13:26,243 C: 98% D:1.1TB M:258.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:13:26,595 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:13:26,603 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:13:26,757 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:13:26,958 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.35063 seconds. 2021-09-15 20:13:26,963 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.72264 seconds. 2021-09-15 20:13:27,287 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 20:13:27,290 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 20:13:27,293 C: 97% D:1.1TB M:257.6GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 20:13:28,235 C: 98% D:1.1TB M:256.7GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.9368 seconds (0.9368 millis per row) 2021-09-15 20:17:54,999 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:17:55,104 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:17:55,423 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:17:55,431 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:17:55,799 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:17:55,824 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.39653 seconds. 2021-09-15 20:17:55,831 C:100% D:1.1TB M:204.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.73062 seconds. 2021-09-15 20:17:56,127 C:100% D:1.1TB M:204.1GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:17:56,233 C:100% D:1.1TB M:204.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:17:56,671 C:100% D:1.1TB M:204.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:17:56,677 C:100% D:1.1TB M:204.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:17:57,135 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:17:57,163 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.48451 seconds. 2021-09-15 20:17:57,167 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.93348 seconds. 2021-09-15 20:17:57,412 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:17:57,507 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:17:57,859 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:17:57,867 C:100% D:1.1TB M:204.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:17:58,211 C:100% D:1.1TB M:204.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:17:58,239 C:100% D:1.1TB M:204.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.37422 seconds. 2021-09-15 20:17:58,243 C:100% D:1.1TB M:204.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.73786 seconds. 2021-09-15 20:17:58,928 C:100% D:1.1TB M:204.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:17:59,019 C:100% D:1.1TB M:204.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:17:59,364 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:17:59,379 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:17:59,619 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:17:59,647 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.27029 seconds. 2021-09-15 20:17:59,651 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.63445 seconds. 2021-09-15 20:17:59,982 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:18:00,091 C:100% D:1.1TB M:204.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:18:00,475 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:18:00,485 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:18:00,923 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:18:00,951 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.47053 seconds. 2021-09-15 20:18:00,955 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.86733 seconds. 2021-09-15 20:18:01,245 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:18:01,354 C:100% D:1.1TB M:203.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:18:01,739 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:18:01,748 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:18:01,919 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 20:18:01,946 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.20100 seconds. 2021-09-15 20:18:01,949 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.59674 seconds. 2021-09-15 20:18:02,549 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 20:18:02,552 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 20:18:02,554 C:100% D:1.1TB M:204.2GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 20:18:03,454 C: 99% D:1.1TB M:202.2GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.8939 seconds (0.8939 millis per row) 2021-09-15 20:20:04,751 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:20:04,877 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:05,196 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:05,202 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:05,504 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:05,732 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.52648 seconds. 2021-09-15 20:20:05,739 C:100% D:1.1TB M:193.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.86544 seconds. 2021-09-15 20:20:05,983 C: 99% D:1.1TB M:192.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:06,374 C: 99% D:1.1TB M:192.8GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:06,387 C: 99% D:1.1TB M:192.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:06,923 C: 99% D:1.1TB M:192.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:07,140 C:100% D:1.1TB M:192.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.75551 seconds. 2021-09-15 20:20:07,151 C:100% D:1.1TB M:192.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.16641 seconds. 2021-09-15 20:20:07,403 C:100% D:1.1TB M:192.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:07,821 C:100% D:1.1TB M:192.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:07,829 C:100% D:1.1TB M:192.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:08,376 C:100% D:1.1TB M:190.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:20:08,616 C:100% D:1.1TB M:190.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.78836 seconds. 2021-09-15 20:20:08,620 C:100% D:1.1TB M:190.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.24595 seconds. 2021-09-15 20:20:08,952 C:100% D:1.1TB M:190.2GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:20:09,080 C:100% D:1.1TB M:190.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:09,487 C:100% D:1.1TB M:188.8GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:09,498 C:100% D:1.1TB M:188.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:10,115 C:100% D:1.1TB M:188.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:10,326 C:100% D:1.1TB M:188.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.83363 seconds. 2021-09-15 20:20:10,332 C:100% D:1.1TB M:188.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.25469 seconds. 2021-09-15 20:20:10,552 C:100% D:1.1TB M:188.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:11,038 C:100% D:1.1TB M:188.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:11,047 C:100% D:1.1TB M:188.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:11,316 C:100% D:1.1TB M:188.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:11,529 C:100% D:1.1TB M:188.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.48121 seconds. 2021-09-15 20:20:11,532 C:100% D:1.1TB M:188.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.98328 seconds. 2021-09-15 20:20:11,886 C:100% D:1.1TB M:187.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:12,156 C:100% D:1.1TB M:187.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:12,162 C:100% D:1.1TB M:187.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:12,347 C:100% D:1.1TB M:187.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:20:12,549 C:100% D:1.1TB M:187.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38481 seconds. 2021-09-15 20:20:12,559 C:100% D:1.1TB M:187.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.67215 seconds. 2021-09-15 20:20:12,920 C:100% D:1.1TB M:187.1GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:20:13,043 C:100% D:1.1TB M:187.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:13,507 C:100% D:1.1TB M:187.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:13,515 C:100% D:1.1TB M:187.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:13,887 C:100% D:1.1TB M:187.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:14,095 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.58177 seconds. 2021-09-15 20:20:14,107 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.06476 seconds. 2021-09-15 20:20:14,323 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:14,647 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:14,654 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:14,860 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:15,067 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.41239 seconds. 2021-09-15 20:20:15,071 C:100% D:1.1TB M:186.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.75530 seconds. 2021-09-15 20:20:15,313 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:15,669 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:15,677 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:15,874 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:20:16,069 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.39418 seconds. 2021-09-15 20:20:16,076 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.76332 seconds. 2021-09-15 20:20:16,490 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:20:16,617 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:16,960 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:16,968 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:17,275 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:17,470 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.50456 seconds. 2021-09-15 20:20:17,474 C:100% D:1.1TB M:186.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.85894 seconds. 2021-09-15 20:20:17,703 C:100% D:1.1TB M:186.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:18,072 C:100% D:1.1TB M:186.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:18,081 C:100% D:1.1TB M:186.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:18,320 C:100% D:1.1TB M:186.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:18,544 C:100% D:1.1TB M:186.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.46074 seconds. 2021-09-15 20:20:18,551 C:100% D:1.1TB M:186.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.85408 seconds. 2021-09-15 20:20:18,764 C: 99% D:1.1TB M:187.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:19,106 C: 99% D:1.1TB M:187.7GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:19,115 C: 99% D:1.1TB M:187.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:19,484 C: 99% D:1.1TB M:187.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:20:19,824 C:100% D:1.1TB M:187.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.70828 seconds. 2021-09-15 20:20:19,839 C:100% D:1.1TB M:187.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.06720 seconds. 2021-09-15 20:20:20,223 C:100% D:1.1TB M:187.9GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:20:20,331 C:100% D:1.1TB M:187.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:20,620 C:100% D:1.1TB M:187.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:20,628 C:100% D:1.1TB M:187.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:21,310 C:100% D:1.1TB M:187.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:21,515 C:100% D:1.1TB M:187.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.88589 seconds. 2021-09-15 20:20:21,519 C:100% D:1.1TB M:187.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.19310 seconds. 2021-09-15 20:20:21,820 C:100% D:1.1TB M:187.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:22,242 C:100% D:1.1TB M:187.3GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:22,250 C:100% D:1.1TB M:187.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:22,556 C:100% D:1.1TB M:187.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:22,757 C:100% D:1.1TB M:187.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.50652 seconds. 2021-09-15 20:20:22,762 C:100% D:1.1TB M:187.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.00823 seconds. 2021-09-15 20:20:24,049 C:100% D:1.1TB M:187.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:24,548 C:100% D:1.1TB M:187.2GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:24,556 C:100% D:1.1TB M:187.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:24,896 C:100% D:1.1TB M:187.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:20:25,164 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.60917 seconds. 2021-09-15 20:20:25,175 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.12877 seconds. 2021-09-15 20:20:25,694 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:20:25,799 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:26,148 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:26,158 C:100% D:1.1TB M:186.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:26,771 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:26,983 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.82626 seconds. 2021-09-15 20:20:26,988 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.19163 seconds. 2021-09-15 20:20:27,196 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:27,447 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:27,459 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:27,735 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:20:27,953 C: 99% D:1.1TB M:185.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.49405 seconds. 2021-09-15 20:20:27,961 C: 99% D:1.1TB M:185.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.77282 seconds. 2021-09-15 20:20:28,179 C: 99% D:1.1TB M:185.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:20:28,551 C: 99% D:1.1TB M:185.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:20:28,555 C: 99% D:1.1TB M:185.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:20:28,871 C: 99% D:1.1TB M:185.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:20:29,071 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.51273 seconds. 2021-09-15 20:20:29,081 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.89915 seconds. 2021-09-15 20:20:29,743 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 20:20:29,747 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 20:20:29,749 C:100% D:1.1TB M:185.8GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 20:20:30,655 C:100% D:1.1TB M:185.6GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.9019 seconds (0.9019 millis per row) 2021-09-15 20:21:46,461 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:21:46,603 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:46,892 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:46,900 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:47,155 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:47,415 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.51623 seconds. 2021-09-15 20:21:47,418 C: 98% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.81845 seconds. 2021-09-15 20:21:47,647 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:47,955 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:47,958 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:48,169 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:48,371 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.41356 seconds. 2021-09-15 20:21:48,375 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.73514 seconds. 2021-09-15 20:21:48,588 C: 99% D:1.1TB M:179.8GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:48,929 C:100% D:1.1TB M:178.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:48,939 C:100% D:1.1TB M:178.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:49,659 C:100% D:1.1TB M:178.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:21:49,868 C:100% D:1.1TB M:178.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.93363 seconds. 2021-09-15 20:21:49,870 C:100% D:1.1TB M:178.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.28430 seconds. 2021-09-15 20:21:50,551 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:21:50,647 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:50,941 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:50,947 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:51,171 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:51,403 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.45197 seconds. 2021-09-15 20:21:51,405 C:100% D:1.1TB M:177.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.75989 seconds. 2021-09-15 20:21:51,580 C: 99% D:1.1TB M:177.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:51,989 C: 99% D:1.1TB M:177.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:51,999 C: 99% D:1.1TB M:177.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:52,210 C: 99% D:1.1TB M:177.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:52,408 C: 99% D:1.1TB M:177.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.41285 seconds. 2021-09-15 20:21:52,410 C: 99% D:1.1TB M:177.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.83263 seconds. 2021-09-15 20:21:52,659 C:100% D:1.1TB M:176.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:52,955 C:100% D:1.1TB M:176.7GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:52,960 C:100% D:1.1TB M:176.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:53,364 C:100% D:1.1TB M:176.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:21:53,559 C:100% D:1.1TB M:176.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.60023 seconds. 2021-09-15 20:21:53,563 C:100% D:1.1TB M:176.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.90832 seconds. 2021-09-15 20:21:54,432 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:21:54,546 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:54,942 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:54,947 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:55,183 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:55,407 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.45778 seconds. 2021-09-15 20:21:55,410 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.86433 seconds. 2021-09-15 20:21:55,639 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:56,002 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:56,009 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:56,164 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:56,359 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.34946 seconds. 2021-09-15 20:21:56,364 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.72988 seconds. 2021-09-15 20:21:56,548 C:100% D:1.1TB M:177.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:56,958 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:56,967 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:57,143 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:21:57,347 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38067 seconds. 2021-09-15 20:21:57,351 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.80506 seconds. 2021-09-15 20:21:57,630 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:21:57,736 C:100% D:1.1TB M:176.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:58,031 C:100% D:1.1TB M:176.3GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:58,041 C:100% D:1.1TB M:176.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:58,393 C:100% D:1.1TB M:176.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:58,604 C:100% D:1.1TB M:176.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.56444 seconds. 2021-09-15 20:21:58,607 C:100% D:1.1TB M:176.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.87364 seconds. 2021-09-15 20:21:58,904 C:100% D:1.1TB M:176.3GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:21:59,158 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:21:59,173 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:21:59,343 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:21:59,539 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36600 seconds. 2021-09-15 20:21:59,544 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.64627 seconds. 2021-09-15 20:21:59,786 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:00,126 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:00,131 C:100% D:1.1TB M:176.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:00,571 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:00,774 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.64462 seconds. 2021-09-15 20:22:00,777 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.99434 seconds. 2021-09-15 20:22:01,001 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:22:01,104 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:01,342 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:01,351 C:100% D:1.1TB M:178.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:01,683 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:01,919 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.56903 seconds. 2021-09-15 20:22:01,923 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.81802 seconds. 2021-09-15 20:22:02,146 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:02,509 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:02,517 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:02,676 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:02,905 C:100% D:1.1TB M:179.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38884 seconds. 2021-09-15 20:22:02,913 C:100% D:1.1TB M:179.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.76817 seconds. 2021-09-15 20:22:03,154 C:100% D:1.1TB M:179.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:03,386 C:100% D:1.1TB M:179.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:03,395 C:100% D:1.1TB M:179.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:04,107 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:04,292 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.89847 seconds. 2021-09-15 20:22:04,296 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.14521 seconds. 2021-09-15 20:22:04,552 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:22:04,652 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:05,061 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:05,073 C:100% D:1.1TB M:180.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:05,576 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:05,815 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.74965 seconds. 2021-09-15 20:22:05,819 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 1.16959 seconds. 2021-09-15 20:22:06,015 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:06,356 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:06,367 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:06,555 C:100% D:1.1TB M:180.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:06,747 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38156 seconds. 2021-09-15 20:22:06,756 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.74187 seconds. 2021-09-15 20:22:06,950 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:07,406 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:07,413 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:07,586 C:100% D:1.1TB M:179.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:07,795 C:100% D:1.1TB M:179.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38051 seconds. 2021-09-15 20:22:07,807 C:100% D:1.1TB M:179.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.85106 seconds. 2021-09-15 20:22:08,195 C:100% D:1.1TB M:179.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:22:08,295 C:100% D:1.1TB M:179.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:08,634 C:100% D:1.1TB M:179.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:08,639 C:100% D:1.1TB M:179.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:08,883 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:09,092 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.45037 seconds. 2021-09-15 20:22:09,095 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.80276 seconds. 2021-09-15 20:22:09,299 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:09,623 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:09,631 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:09,784 C:100% D:1.1TB M:179.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:09,995 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36768 seconds. 2021-09-15 20:22:10,011 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.70912 seconds. 2021-09-15 20:22:10,267 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:10,515 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:10,522 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:10,681 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:10,895 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36836 seconds. 2021-09-15 20:22:10,899 C:100% D:1.1TB M:182.9GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.64824 seconds. 2021-09-15 20:22:11,143 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:22:11,235 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:11,587 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:11,595 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:11,779 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:11,987 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.39248 seconds. 2021-09-15 20:22:11,991 C:100% D:1.1TB M:183.4GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.75510 seconds. 2021-09-15 20:22:12,187 C:100% D:1.1TB M:184.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:12,541 C:100% D:1.1TB M:184.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:12,546 C:100% D:1.1TB M:184.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:12,919 C:100% D:1.1TB M:184.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:13,175 C:100% D:1.1TB M:184.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.62745 seconds. 2021-09-15 20:22:13,179 C:100% D:1.1TB M:184.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.99337 seconds. 2021-09-15 20:22:13,415 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:13,691 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:13,700 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:13,927 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:14,127 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.42778 seconds. 2021-09-15 20:22:14,131 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.72493 seconds. 2021-09-15 20:22:14,362 C:100% D:1.1TB M:184.7GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:22:14,457 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:14,688 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:14,695 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:14,852 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:15,063 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36698 seconds. 2021-09-15 20:22:15,066 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.60867 seconds. 2021-09-15 20:22:15,279 C: 99% D:1.1TB M:184.2GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:15,624 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:15,633 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:15,804 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:16,019 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38912 seconds. 2021-09-15 20:22:16,024 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.74843 seconds. 2021-09-15 20:22:16,213 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:16,511 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:16,518 C: 99% D:1.1TB M:184.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:16,717 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:16,901 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38366 seconds. 2021-09-15 20:22:16,906 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.69512 seconds. 2021-09-15 20:22:17,203 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 20:22:17,294 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:17,555 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:17,563 C:100% D:1.1TB M:183.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:17,741 C: 99% D:1.1TB M:183.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:17,946 C: 99% D:1.1TB M:183.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.38050 seconds. 2021-09-15 20:22:17,951 C: 99% D:1.1TB M:183.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.65868 seconds. 2021-09-15 20:22:18,168 C: 99% D:1.1TB M:183.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:18,599 C: 99% D:1.1TB M:183.1GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:18,608 C: 99% D:1.1TB M:183.1GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:18,764 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 500 iterations: 500 2021-09-15 20:22:18,975 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.36939 seconds. 2021-09-15 20:22:18,980 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.81450 seconds. 2021-09-15 20:22:19,219 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 20:22:19,514 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 20:22:19,522 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 20:22:19,686 C: 99% D:1.1TB M:182.6GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 473 iterations: 473 2021-09-15 20:22:19,875 C: 99% D:1.1TB M:182.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.35517 seconds. 2021-09-15 20:22:19,887 C: 99% D:1.1TB M:182.0GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.66472 seconds. 2021-09-15 20:22:20,732 C: 99% D:1.1TB M:182.0GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 20:22:20,736 C: 99% D:1.1TB M:182.0GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 20:22:20,739 C: 99% D:1.1TB M:182.0GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 20:22:21,479 C: 99% D:1.1TB M:181.3GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.7354 seconds (0.7354 millis per row) 2021-09-15 22:11:41,501 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:41,587 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:41,791 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:41,798 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:41,960 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:41,988 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.19206 seconds. 2021-09-15 22:11:41,991 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.40776 seconds. 2021-09-15 22:11:42,203 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:42,278 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:42,465 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:42,472 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:42,639 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:42,668 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.19729 seconds. 2021-09-15 22:11:42,672 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.39538 seconds. 2021-09-15 22:11:42,869 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:42,962 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:43,196 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:43,205 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:43,358 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:43,384 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.18334 seconds. 2021-09-15 22:11:43,386 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.42789 seconds. 2021-09-15 22:11:43,593 C: 9% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:43,672 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:43,885 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:43,895 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:44,064 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:44,091 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.20110 seconds. 2021-09-15 22:11:44,093 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.42524 seconds. 2021-09-15 22:11:44,316 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:44,397 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:44,599 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:44,605 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:44,735 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:44,761 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.15797 seconds. 2021-09-15 22:11:44,763 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.37004 seconds. 2021-09-15 22:11:44,983 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:45,063 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:45,264 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:45,273 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:45,423 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:45,448 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.17942 seconds. 2021-09-15 22:11:45,450 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.39190 seconds. 2021-09-15 22:11:45,664 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:45,747 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:45,958 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:45,966 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:46,127 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:46,162 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.19825 seconds. 2021-09-15 22:11:46,166 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.42113 seconds. 2021-09-15 22:11:46,357 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:46,462 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:46,704 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:46,712 C: 7% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:46,864 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:46,895 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.18570 seconds. 2021-09-15 22:11:46,898 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.44098 seconds. 2021-09-15 22:11:47,110 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:47,190 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:47,381 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:47,388 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:47,553 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:47,584 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.19756 seconds. 2021-09-15 22:11:47,587 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.40030 seconds. 2021-09-15 22:11:47,807 C: 10% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Not using MOJO for predictions since X has more rows than mojo_for_predictions_max_rows 2021-09-15 22:11:47,888 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 start. 2021-09-15 22:11:48,113 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Submitted 1 and Completed 1 non-identity feature engineering tasks out of 7 total tasks (including 6 identity) 2021-09-15 22:11:48,120 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 start. 2021-09-15 22:11:48,265 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] Number of trees: 50 iterations: 500 2021-09-15 22:11:48,294 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] (20000, 10) model predict shape=(20000, 10) threads=4 end. Took 0.17589 seconds. 2021-09-15 22:11:48,297 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | [LightGBMModel] model predict_with_transform shape=(20000, 6) threads=4 end. Took 0.41213 seconds. 2021-09-15 22:11:48,874 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | Using MOJO for predictions 2021-09-15 22:11:48,877 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx=True since not implemented. 2021-09-15 22:11:48,879 C: 8% D:1.1TB M:258.5GB NODE:LOCAL1 38885 WARNING| MOJO ignores fast approx_contribs=True since not implemented. 2021-09-15 22:11:49,520 C: 6% D:1.1TB M:258.5GB NODE:LOCAL1 38885 INFO | scored 1000 rows using MOJO in 0.6351 seconds (0.6351 millis per row)