2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | # Copyright 2020 H2O.ai; Proprietary License; -*- encoding: utf-8 -*- 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | ------------------------------------------------------------------------------- 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | H2O DRIVERLESS AI EXPERIMENT LOGFILE 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | PROPRIETARY LICENSE - 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | USE OF ANY PART OF THIS SOFTWARE REQUIRES A VALID, 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | ONGOING LICENSE AGREEMENT WITH H2O.AI. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | Please contact sales@h2o.ai for more information. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | ------------------------------------------------------------------------------- 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | H2O.AI 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | END USER SOFTWARE LICENSE AGREEMENT 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | (Last Updated: March 26, 2020) 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | IMPORTANT: PLEASE READ BEFORE INSTALLATION OR USE OF THE H2O.AI (“LICENSOR”) SOFTWARE. YOU HAVE PURCHASED A LICENSE TO (“SOFTWARE”). BY INSTALLING OR IN ANY WAY USING THE SOFTWARE, THE ENTITY OR COMPANY THAT YOU REPRESENT ("LICENSEE") IS UNCONDITIONALLY CONSENTING TO BE BOUND BY AND IS BECOMING A PARTY TO THIS LICENSE AGREEMENT ("AGREEMENT") WITH LICENSOR. IF LICENSEE DOES NOT UNCONDITIONALLY AGREE TO ALL OF THE TERMS OF THIS AGREEMENT, INSTALLATION OR USE SOFTWARE IS STRICTLY PROHIBITED. IF THESE TERMS ARE CONSIDERED AN OFFER, ACCEPTANCE IS EXPRESSLY LIMITED TO THESE TERMS. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | IN THE EVENT THERE IS A SEPARATELY NEGOTIATED AND EXECUTED MASTER SERVICES AGREEMENT BETWEEN LICENSOR AND LICENSEE WITH RESPECT TO PROCUREMENT OF THE SOFTWARE, SUCH AGREEMENT SHALL CONTROL AND THIS AGREEMENT WILL NOT APPLY. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 1. LICENSE GRANT. Subject to the terms of this Agreement, Licensor hereby grants Licensee a limited, personal, non-sublicensable, non-transferable, nonexclusive license to use the Software (in object code form only) only for Licensee’s internal use for the purpose for which it is provided and only in accordance with any Licensor-provided documentation (including as provided electronically). The Software may be accessed by the number of users agreed to by the Licensor and Licensee during the purchase process (e.g. on an order form). Such users will be specific individuals named by Licensee during the purchase process, or subsequently, in writing (email is sufficient). Once such named individuals are selected by Licensee – they may be changed only on written notice to Licensor (email is sufficient). The named individuals will not allow any other Licensee personnel to use their Software log-in credentials (passwords, etc.). No source code will be provided. To the extent the Software is provided for no charge or on an evaluation basis (in either case, “Evaluation Basis”), this Agreement may be terminated by Licensor at any time, for any or no reason, on five (5) days written notice. Licensee acknowledges that other sections of this Agreement contain terms and conditions specific to services provided on an Evaluation Basis. In the event Licensee purchases additional modules or add-ons to Software (including, without limitation, any features or functions that H2O charges other customers for), they will be deemed “Software” and, therefore, subject to this Agreement (unless Licensor provides them pursuant to different terms and conditions). With respect to any Licensee proposed modifications, derivatives, enhancements or improvements to the Software (“Feedback”), Licensee hereby grants H2O.ai a perpetual, irrevocable, royalty free, fully paid-up, sub-licensable, right and license to use, display, reproduce, distribute and otherwise fully exploit such Feedback for any purposes. All Feedback is provided by Licensee “AS IS”. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 1. LICENSE RESTRICTIONS. Except as expressly and unambiguously permitted by this Agreement, Licensee shall not, nor permit anyone else to, directly or indirectly: (i) copy, modify, resell or distribute the Software; (ii) reverse engineer, disassemble, decompile or otherwise attempt to discover the source code or structure, sequence and organization of the Software (except the foregoing will not apply to the extent prohibited by applicable local law); (iii) rent, lease, or use the Software for timesharing or service bureau purposes, or otherwise use the Software on behalf of any third party; (iv) use the Software to develop any other product or services whether delivered internally or as an external service offering or (v) use the Software for performing comparisons or other "benchmarking" activities, either alone or in connection with any other software (and Licensee will not publish or disclose any such performance information or comparisons). Licensee shall maintain and not remove or obscure any proprietary notices on or in the Software. As between the parties, title, ownership rights, and intellectual property rights in and to the Software, and any copies or portions thereof, shall remain in Licensor and its suppliers or licensors. Licensee understands that Licensor may modify or discontinue offering the Software at any time (provided that, if Licensee has purchased a term-based license – such discontinuance will only take place at the end of the then-current term). The Software is protected by the copyright laws and treaties. This Agreement does not give Licensee any rights not expressly granted herein. On ten (10) days notice, Licensor shall have the right to (itself or through a designated third party) audit Licensee’s facilities, networks, systems, books and records to confirm Licensee’s use of the Software is in accordance with the terms and conditions of this Agreement. Licensee will fully cooperate and assist with such audits. 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 2. SUPPORT AND UPGRADES. During the term of this Agreement Licensor will provide Licensee with Software support according to Licensor’s general support practices and procedures. Licensee acknowledges that the Software contains features that allow Licensor to remotely and automatically identify, track and analyze certain aspects of use and performance of Software and/or the systems on which it is installed, as well as the operator and operating environment (including problems and issues that arise in connection therewith). 2021-08-20 00:48:40,832 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 3. FEES. To the extent the Software is procured via a reseller – and Licensee pays such reseller for the Software – Licensee will not owe fees directly to Licensor hereunder. With respect to any other procurement of the Software, Licensee shall pay Licensor (or its applicable authorized reseller) the fees (if any) for the Software as agree to by the parties in writing at the time of purchase. Such fees are payable within thirty (30) days from the date of invoice , are non-refundable and payable in US dollars. Licensee shall also pay all sales, use, value-added and other taxes, tariffs and duties of any type assessed against Licensor except for taxes on Licensor’s income. Late fees will be subject to a finance charge of the lesser of (i) 1.5% per thirty (30) day period and (ii) the greatest amount allowed by applicable law. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 4. INDEMNITY. Licensee shall indemnify and hold harmless Licensor from any claims, damages, liabilities, costs and fees (including reasonable attorney fees) arising from Licensee’s use of the Software as well as from Licensee’s negligence, willful misconduct or failure to comply with any term of this Agreement. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 5. LIMITED WARRANTY. Licensor warrants to Licensee that all Software will conform materially with the Documentation. In the event of a breach of this Section, Licensee’s sole remedy, and Licensor’s exclusive liability, shall be for H2O to use commercially reasonable efforts to correct any such defect(s); provided that, Licensee specifically notifies Licensor in writing of the defect(s) within thirty (30) days form the date Licensee first experiences the defect. Such corrections will be in accordance with Licensor’s standard practices (such as release cycles) that it provides to its other general customers. This Section 6 will not apply to Software provided on an evaluation basis (or any other no-fee basis). 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 6. WARRANTY DISCLAIMER. EXCEPT AS EXPRESSLY SET FORTH IN SECTION 6, LICENSOR AND ITS SUPPLIERS PROVIDE The SOFTWARE "AS IS" and without warranty of any kind, AND hereby disclaims all express or implied warranties, including without limitation warranties of merchantability, fitness for a particular purpose, PERFORMANCE, ACCURACY, RELIABILITY, and non-infringement. This disclaimer of warranty constitutes an essential part of this Agreement. SOME STATES DO NOT ALLOW LIMITATIONS ON HOW LONG AN IMPLIED WARRANTY LAST SO THE FOREGOING LIMITATIONS MAY NOT APPLY TO LICENSEE. NOTWITHSTANDING ANY OF THE FOREGOING (INCLUDING SECTION 6) – NO WARRANTIES OF ANY KIND ARE MADE WITH RESPECT TO SOFTWARE PROVIDED ON AN EVALUATION BASIS). 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 7. LIMITATION OF LIABILITY. UNDER NO CIRCUMSTANCES AND UNDER NO LEGAL THEORY, INCLUDING, BUT NOT LIMITED TO, TORT, CONTRACT, NEGLIGENCE, STRICT LIABILITY, OR OTHERWISE, SHALL LICENSOR OR ITS SUPPLIERS OR RESELLERS BE LIABLE TO LICENSEE OR ANY OTHER PERSON IN CONNECTION WITH THE SOFTWARE OR ANY OTHER SUBJECT MATTER OF THIS AGREEMENT FOR ANY: (I) INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES OF ANY CHARACTER INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOST PROFITS, LOSS OF GOODWILL, WORK STOPPAGE, ACCURACY OF RESULTS, COMPUTER FAILURE OR MALFUNCTION, (II) ANY AMOUNTS IN THE AGGREGATE IN EXCESS OF THE FEES PAID BY LICENSEE HEREUNDER DURING THE TWELVE (12) MONTH PERIOD PRIOR TO THE DATE THE CAUSE OF ACTION ACCRUES (BUT IF NO FEES HAVE BEEN PAID, SUCH AS FOR SOFTWARE PROVIDED ON AN EVALUATION BASIS, THE DAMAGES CAP WILL BE US$1,000.00), (III) THE COST OF PROCUREMENT OF SUBSTITUTE SOFTWARE OR (IV) MATTERS BEYOND ITS REASONABLE CONTROL. THE FOREGOING LIMITATIONS SHALL APPLY EVEN IF LICENSOR SHALL HAVE BEEN INFORMED OF THE POSSIBILITY OF SUCH DAMAGES. SOME STATES DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES, SO THE ABOVE LIMITATION AND EXCLUSION MAY NOT APPLY TO LICENSEE. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 8. TERM AND TERMINATION. This Agreement is effective as of the Effective Date and, unless otherwise agreed to by the parties in writing, will have the initial subscription term of one (1) year. Thereafter, it will automatically renew for successive renewal subscription terms of equal length to its initial subscription term, unless either party provides the other party with written notice of non-renewal at least sixty (60) days prior to the expiration of the then-current subscription term. The initial subscription term and all renewals are referred to collectively as the “Subscription Term”. Notwithstanding the foregoing, Software provided on an Evaluation Basis will, unless otherwise agreed in writing, have a term of thirty (30) days. In addition, either party may terminate this Agreement on written notice if the other party (a) fails to cure any material breach of this Agreement within thirty (30) days after written notice (ten (10) days in the case of non-payment or in the event Licensee breaches any license or use restrictions); (b) ceases operation without a successor; or (c) seeks protection under any bankruptcy, receivership, trust deed, creditors’ arrangement, composition, or comparable proceeding, or if any such proceeding is instituted against that party (and not dismissed within ninety (90) days thereafter). With respect to Customer’s breach of its payment obligations, or any license or use restrictions, electronic notice to Customer is sufficient hereunder. Any termination of this Agreement shall also terminate the licenses granted hereunder. Upon termination of this Agreement for any reason, Licensee shall destroy and remove from all computers, hard drives, networks, and other storage media all copies of the Software, and shall, if requested by Licensor, so certify to Licensor in writing that such actions have occurred. Sections 2 and 4 through 14, and all accrued rights to payment, shall survive termination of this Agreement. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 9. GOVERNMENT USE. If Licensee is part of an agency, department, or other entity of the United States Government ("Government"), the use, duplication, reproduction, release, modification, disclosure or transfer of the Software is restricted in accordance with the Federal Acquisition Regulations as applied to civilian agencies and the Defense Federal Acquisition Regulation Supplement as applied to military agencies. The Software is "commercial computer software" and "commercial computer software documentation." In accordance with such provisions, any use of the Software by the Government shall be governed solely by the terms of this Agreement. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 10. EXPORT CONTROLS. Licensee shall comply with all export laws and restrictions and regulations of the Department of Commerce, the United States Department of Treasury Office of Foreign Assets Control ("OFAC"), or other United States or foreign agency or authority, and Licensee shall not export, or allow the export or re-export of the Software in violation of any such restrictions, laws or regulations. By installing or using the Software, Licensee agrees to the foregoing and represents and warrants that Licensee is not located in, under the control of, or a national or resident of any restricted country. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 11. NOTICE. Any notice or communication required or permitted under this Agreement shall be in writing to the parties at: (i) if to Licensee, the address listed by Licensee during the Software registration process (or as otherwise provided by Licensee) and (ii) if to Licensor, H2O.ai, Inc. Attn: Contract Administration (or at such other address as may be given by Licensor at any time) - and shall be deemed to have been received by the addressee (iii) if given by hand, immediately upon receipt; (iv) if given by overnight courier service, the first business day following dispatch or (v) if given by registered or certified mail, postage prepaid and return receipt requested, the second business day after such notice is deposited in the mail. In addition, to be effective, legal notices to Licensor (such as for breach) must also be provided in email to: salesops@h2o.ai (subject heading: Attn: Legal Notice) (but, notwithstanding earlier receipt via email, legal notices will be deemed received when the physical notice is received as set forth in preceding sentence). Notwithstanding the foregoing, an electronic notice to Licensee (such as via email) is sufficient to the extent related to breach or termination. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 12. LOGO USAGE. During the term of this Agreement and for a reasonable wind-down period thereafter, Licensor may use Licensee’s name and logo on its website and in marketing materials as part of a general list of customers. 2021-08-20 00:48:40,833 C: NA D: NA M: NA NODE:SERVER 7646 INFO | 13. MISCELLANEOUS. Licensor shall have the right to inspect and audit Licensee’s facilities to confirm Licensee’s compliance with this Agreement. This Agreement represents the complete agreement concerning the Software between the parties, to the exclusion of any pre-printed or contrary terms of any Licensee purchase order (or similar document), and supersedes all prior agreements and representations between them; provided, however, that if there is already a mutually signed agreement between Licensor and Licensee (not including any Licensee purchase order or similar document) covering Licensee’s purchase of a license to use the Software, then the express terms of that signed agreement will govern to the extent they are expressly contrary to this Agreement. This Agreement may be amended only by a writing executed by both parties. If any provision of this Agreement is held to be unenforceable for any reason, such provision shall be reformed only to the extent necessary to make it enforceable. The failure of Licensor to act with respect to a breach of this Agreement by Licensee or others does not constitute a waiver and shall not limit Licensor’s rights with respect to such breach or any subsequent breaches. This Agreement is personal to Licensee and may not be assigned or transferred for any reason whatsoever without Licensor’s consent and any action or conduct in violation of the foregoing shall be void and without effect. Licensor expressly reserves the right to assign this Agreement and to delegate any of its obligations hereunder. This Agreement shall be governed by and construed under California law as such law applies to agreements between California residents entered into and to be performed within California, without regard to the Uniform Computer Information Transactions Act. Without limiting Company’s right to seek injunctive or other equitable relief in court, either party may elect (by written notice given prior filing a complaint or, in the case of the defendant, prior to answering a complaint) to resolve a dispute by binding arbitration in the English language in San Francisco, California under the Rules and Procedures of the Judicial Arbitration and Mediation Service, Inc.; the decision of the arbitrator will be enforceable in any court. The JAMS Streamlined Rules will be used if available. Subject to the foregoing, all disputes will be subject to the sole and exclusive jurisdiction of, and venue in, the state and federal courts located in San Francisco, California. The party prevailing in any dispute under this Agreement shall be entitled to its costs and legal fees. 2021-08-20 00:48:40,834 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Python version: 3.8.5 (default, Sep 4 2020, 07:30:14) 2021-08-20 00:48:40,836 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | [GCC 7.3.0] 2021-08-20 00:48:40,838 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Current locale: en_US.UTF-8 2021-08-20 00:48:40,840 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Build version: 4d0fa399cc29d558c62ec11a55d326d1036c08e7 2021-08-20 00:48:40,841 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Set for no core dumps 2021-08-20 00:48:40,878 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Physical device for temporary directory: /dev/sda2 2021-08-20 00:48:41,076 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | h2oaicore hashes: wheel=4d0fa399cc29d558c62ec11a55d326d1036c08e7 git= jen=None 2021-08-20 00:48:41,078 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:41,089 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Driverless AI Config Settings 2021-08-20 00:48:41,091 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | Modify config.toml or set DRIVERLESS_AI_= to override (double-quote arrays) 2021-08-20 00:48:41,094 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:41,096 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | abs_tol_for_perfect_score : 0.0001 2021-08-20 00:48:41,099 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | acceptance_test_timeout : 20.0 2021-08-20 00:48:41,101 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | acceptance_tests_max_number_of_parameter_combinations : 20 2021-08-20 00:48:41,105 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | additional_authentication_methods : [] 2021-08-20 00:48:41,109 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | agg_funcs_for_group_by : ['mean', 'sd', 'min', 'max', 'count'] 2021-08-20 00:48:41,112 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_any_call_to_skip_failures : True 2021-08-20 00:48:41,115 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_change_layer_count_brain : False 2021-08-20 00:48:41,117 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_concurrent_sessions : True 2021-08-20 00:48:41,120 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_config_overrides_in_expert_page : True 2021-08-20 00:48:41,124 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_debug_context : True 2021-08-20 00:48:41,127 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_different_classes_across_fold_splits : True 2021-08-20 00:48:41,129 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_form_autocomplete : True 2021-08-20 00:48:41,132 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_localstorage : True 2021-08-20 00:48:41,135 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_non_dai_dask_cluster_for_testing : False 2021-08-20 00:48:41,138 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_old_recipes_use_datadir_as_data_directory : True 2021-08-20 00:48:41,142 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_orig_cols_in_predictions : True 2021-08-20 00:48:41,145 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_reduce_features_when_failure : auto 2021-08-20 00:48:41,148 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | allow_version_change_user_packages : False 2021-08-20 00:48:41,151 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_introspection_enabled : False 2021-08-20 00:48:41,154 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_introspection_method : OAUTH2_TOKEN_INTROSPECTION 2021-08-20 00:48:41,157 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_oauth2_scopes : 2021-08-20 00:48:41,160 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | api_token_oauth2_username_field_name : username 2021-08-20 00:48:41,163 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | app_language : en 2021-08-20 00:48:41,166 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | apply_featuregene_limits_after_tuning : True 2021-08-20 00:48:41,169 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_file_system_directory : tmp 2021-08-20 00:48:41,172 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_branch : dev 2021-08-20 00:48:41,174 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_repo : 2021-08-20 00:48:41,177 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_ssh_private_key_file_location : 2021-08-20 00:48:41,179 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_git_user : git 2021-08-20 00:48:41,182 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_s3_bucket : 2021-08-20 00:48:41,185 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | artifacts_store : file_system 2021-08-20 00:48:41,188 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | assumed_simultaneous_dt_forks_munging : 3 2021-08-20 00:48:41,190 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | assumed_simultaneous_dt_forks_stats_openblas : 1 2021-08-20 00:48:41,193 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_algorithm : HS256 2021-08-20 00:48:41,195 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_cookie_name : 2021-08-20 00:48:41,198 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_exp_leeway_seconds : 0 2021-08-20 00:48:41,200 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_header_name : 2021-08-20 00:48:41,203 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_required_audience : 2021-08-20 00:48:41,205 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_required_issuer : 2021-08-20 00:48:41,208 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_source_parse_regexp : (?P.*) 2021-08-20 00:48:41,210 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_token_source : HEADER 2021-08-20 00:48:41,213 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_username_claim_name : sub 2021-08-20 00:48:41,215 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_jwt_verify : True 2021-08-20 00:48:41,218 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_access_token_expiry_key : expires_in 2021-08-20 00:48:41,220 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_auth_uri : 2021-08-20 00:48:41,223 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_configuration_uri : 2021-08-20 00:48:41,225 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_default_scopes : 2021-08-20 00:48:41,228 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_end_session_endpoint_url : 2021-08-20 00:48:41,231 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_grant_type : 2021-08-20 00:48:41,233 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_logout_uri : 2021-08-20 00:48:41,236 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_provider_base_uri : 2021-08-20 00:48:41,238 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_redirect_uri : 2021-08-20 00:48:41,241 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_refresh_token_expiry_key : refresh_expires_in 2021-08-20 00:48:41,243 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_response_type : 2021-08-20 00:48:41,245 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_scope : 2021-08-20 00:48:41,249 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_token_expiration_secs : 3600 2021-08-20 00:48:41,252 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_token_introspection_url : 2021-08-20 00:48:41,255 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_token_uri : 2021-08-20 00:48:41,257 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_urlencode_quote_via : quote 2021-08-20 00:48:41,260 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_use_objectpath_expression : 2021-08-20 00:48:41,262 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_use_objectpath_match : False 2021-08-20 00:48:41,265 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_openid_userinfo_uri : 2021-08-20 00:48:41,267 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_crl_file : 2021-08-20 00:48:41,269 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_field_parse_regexp : (?P.*) 2021-08-20 00:48:41,274 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_authorization_lookup_filter : 2021-08-20 00:48:41,276 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_authorization_search_base : 2021-08-20 00:48:41,279 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_bind_dn : 2021-08-20 00:48:41,281 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_port : 2021-08-20 00:48:41,284 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_search_base : 2021-08-20 00:48:41,286 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_search_filter : 2021-08-20 00:48:41,289 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_server : 2021-08-20 00:48:41,291 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_tls_file : 2021-08-20 00:48:41,294 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_use_ssl : False 2021-08-20 00:48:41,296 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_ldap_username_attribute : 2021-08-20 00:48:41,300 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_subject_field : CN 2021-08-20 00:48:41,303 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | auth_tls_user_lookup : REGEXP_ONLY 2021-08-20 00:48:41,306 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | authentication_default_timeout_hours : 72.0 2021-08-20 00:48:41,308 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | authentication_gui_polling_prolongs_session : False 2021-08-20 00:48:41,310 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | authentication_method : unvalidated 2021-08-20 00:48:41,313 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodl_stall_kill_segv : True 2021-08-20 00:48:41,315 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodl_stall_sigusr1 : True 2021-08-20 00:48:41,318 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_additional_template_folder : 2021-08-20 00:48:41,320 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_appendix_results_table : False 2021-08-20 00:48:41,323 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_classes : 9 2021-08-20 00:48:41,325 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_coef : 50 2021-08-20 00:48:41,328 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_folds : -1 2021-08-20 00:48:41,330 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_coef_table_num_models : 1 2021-08-20 00:48:41,333 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_data_summary_col_num : -1 2021-08-20 00:48:41,336 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_enable_shapley_values : True 2021-08-20 00:48:41,338 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_feature_importance_num_perm : 1 2021-08-20 00:48:41,341 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_feature_importance_scorer : 2021-08-20 00:48:41,343 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_full_architecture_in_appendix : False 2021-08-20 00:48:41,347 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_gini_plot : False 2021-08-20 00:48:41,350 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_global_klime_num_features : 10 2021-08-20 00:48:41,352 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_global_klime_num_tables : 1 2021-08-20 00:48:41,355 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_include_permutation_feature_importance : False 2021-08-20 00:48:41,357 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_keras_summary_line_length : -1 2021-08-20 00:48:41,360 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_list_all_config_settings : False 2021-08-20 00:48:41,365 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_max_cm_size : 10 2021-08-20 00:48:41,368 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_min_relative_importance : 0.003 2021-08-20 00:48:41,372 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_num_features : 50 2021-08-20 00:48:41,374 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_num_histogram_plots : 10 2021-08-20 00:48:41,377 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_num_rows : 0 2021-08-20 00:48:41,379 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_out_of_range : 3 2021-08-20 00:48:41,382 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_output_type : docx 2021-08-20 00:48:41,384 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_pd_max_rows : 10000 2021-08-20 00:48:41,387 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_pd_max_runtime : 45 2021-08-20 00:48:41,389 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_population_stability_index : False 2021-08-20 00:48:41,392 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_population_stability_index_n_quantiles : 10 2021-08-20 00:48:41,395 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_prediction_stats : False 2021-08-20 00:48:41,398 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_prediction_stats_n_quantiles : 20 2021-08-20 00:48:41,402 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_report_name : report 2021-08-20 00:48:41,405 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_response_rate : False 2021-08-20 00:48:41,408 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_response_rate_n_quantiles : 10 2021-08-20 00:48:41,412 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_subtemplate_type : auto 2021-08-20 00:48:41,415 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_template : 2021-08-20 00:48:41,418 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autodoc_transformer_architecture_max_lines : 30 2021-08-20 00:48:41,421 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autoviz_max_aggregated_rows : 500 2021-08-20 00:48:41,424 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | autoviz_max_num_columns : 50 2021-08-20 00:48:41,427 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aux_threshold_data_size_large : 10000000 2021-08-20 00:48:41,431 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_default_region : 2021-08-20 00:48:41,434 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_role_arn : 2021-08-20 00:48:41,436 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_s3_endpoint_url : 2021-08-20 00:48:41,439 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | aws_use_ec2_role_credentials : False 2021-08-20 00:48:41,441 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_ad_auth_uri : 2021-08-20 00:48:41,444 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_ad_client_id : 2021-08-20 00:48:41,446 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_ad_scopes : [] 2021-08-20 00:48:41,449 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_init_path : https:// 2021-08-20 00:48:41,452 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_keycloak_aad_auth_uri : 2021-08-20 00:48:41,454 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_keycloak_aad_client_id : 2021-08-20 00:48:41,457 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_keycloak_broker_token_endpoint : 2021-08-20 00:48:41,459 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_use_access_token : False 2021-08-20 00:48:41,462 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_use_access_token_scopes : https://storage.azure.com/.default 2021-08-20 00:48:41,465 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_blob_use_access_token_source : SESSION 2021-08-20 00:48:41,468 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_enable_token_auth_aad : False 2021-08-20 00:48:41,470 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | azure_keycloak_idp_token_endpoint : 2021-08-20 00:48:41,472 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | batch_cpu_tuning_max_workers : 0 2021-08-20 00:48:41,475 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benchmark_mojo_latency : auto 2021-08-20 00:48:41,478 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benchmark_mojo_latency_auto_size_limit : 500 2021-08-20 00:48:41,480 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benford_mad_threshold_int : 0.03 2021-08-20 00:48:41,483 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | benford_mad_threshold_real : 0.1 2021-08-20 00:48:41,485 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bert_migration_timeout_secs : 600 2021-08-20 00:48:41,487 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bitbucket_skip_cert_verification : False 2021-08-20 00:48:41,490 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bitbucket_tmp_relative_dir : local_git_tmp 2021-08-20 00:48:41,492 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | booster_for_fs_permute : auto 2021-08-20 00:48:41,495 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bootstrap_final_seed : -1 2021-08-20 00:48:41,497 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | bootstrap_ladder_samples_limit : 10 2021-08-20 00:48:41,500 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_add_features_for_new_columns : True 2021-08-20 00:48:41,502 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_food_full : False 2021-08-20 00:48:41,505 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_inconsistent_asserts : False 2021-08-20 00:48:41,511 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_max_size_GB : 20 2021-08-20 00:48:41,513 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_maximum_diff_score : 0.1 2021-08-20 00:48:41,516 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_meta_info : False 2021-08-20 00:48:41,521 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | brain_rel_dir : H2O.ai_brain 2021-08-20 00:48:41,523 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | can_skip_final_upper_layer_failures : True 2021-08-20 00:48:41,526 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_1_vs_N : False 2021-08-20 00:48:41,528 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_clinfo_timeout_per_gpu : 20 2021-08-20 00:48:41,531 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_clinfo_trials : 3 2021-08-20 00:48:41,536 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_distribution_shift : auto 2021-08-20 00:48:41,539 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_distribution_shift_drop : auto 2021-08-20 00:48:41,542 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_graphviz_timeout : 60 2021-08-20 00:48:41,544 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_java_timeout : 30 2021-08-20 00:48:41,547 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_leakage : auto 2021-08-20 00:48:41,549 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_pred_contribs_sum : True 2021-08-20 00:48:41,553 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | check_system : True 2021-08-20 00:48:41,555 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | clinfo_exit_if_fails : True 2021-08-20 00:48:41,558 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | collect_server_logs_in_experiment_logs : False 2021-08-20 00:48:41,560 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cols_to_drop : 2021-08-20 00:48:41,562 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cols_to_group_by : 2021-08-20 00:48:41,565 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | columns_count_interpretable : 200 2021-08-20 00:48:41,570 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | compute_correlation : False 2021-08-20 00:48:41,572 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | config_overrides : 2021-08-20 00:48:41,575 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | contrib_env_relative_directory : contrib/env 2021-08-20 00:48:41,577 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | contrib_relative_directory : contrib 2021-08-20 00:48:41,579 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | contrib_reload_and_recheck_server_start : True 2021-08-20 00:48:41,582 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_gpu_stall_max_count : 10 2021-08-20 00:48:41,584 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_max_workers : 0 2021-08-20 00:48:41,587 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_percent_check_period_gpulock_stalled : 1.0 2021-08-20 00:48:41,589 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_percent_check_period_stalled : 0.3 2021-08-20 00:48:41,592 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_percent_per_experiment_check_period_logging : 0.1 2021-08-20 00:48:41,596 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cpu_stall_max_factor_interval : 20 2021-08-20 00:48:41,598 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cross_validate_meta_learner : False 2021-08-20 00:48:41,601 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cross_validate_single_final_model : True 2021-08-20 00:48:41,603 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cuml_shapley_as_imp_min_sample_size_threshold : 30 2021-08-20 00:48:41,607 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cuml_shapley_as_imp_sample_size : 100 2021-08-20 00:48:41,609 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cupy_check_import : True 2021-08-20 00:48:41,612 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_excluded_filenames_from_repo_download : [] 2021-08-20 00:48:41,614 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_git_branch : None 2021-08-20 00:48:41,617 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_git_repo : https://github.com/h2oai/driverlessai-recipes 2021-08-20 00:48:41,619 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | custom_recipes_lock_to_git_repo : False 2021-08-20 00:48:41,622 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_alt : 0 2021-08-20 00:48:41,625 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_average_folds_for_global_lookup : False 2021-08-20 00:48:41,627 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_cv_in_cv : True 2021-08-20 00:48:41,630 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_cv_in_cv_cvte : True 2021-08-20 00:48:41,632 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_cv_in_cv_woe : True 2021-08-20 00:48:41,636 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_debug_print : False 2021-08-20 00:48:41,639 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_gini_tol : 0.01 2021-08-20 00:48:41,641 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | cvte_max_outer_cv : 5 2021-08-20 00:48:41,644 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cluster_kwargs * : {'n_workers': 1, 'processes': True, 'threads_per_worker': 1, 'scheduler_port': 0, 'dashboard_address': ':0', 'protocol': 'tcp'} 2021-08-20 00:48:41,646 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_cluster_kwargs * : {'scheduler_port': 0, 'dashboard_address': ':0', 'protocol': 'tcp'} 2021-08-20 00:48:41,649 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_dashboard_port : 8791 2021-08-20 00:48:41,651 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_protocol : tcp 2021-08-20 00:48:41,654 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_scheduler_env * : {} 2021-08-20 00:48:41,656 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_scheduler_options : 2021-08-20 00:48:41,658 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_server_port : 8790 2021-08-20 00:48:41,661 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_worker_env * : {} 2021-08-20 00:48:41,664 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_worker_nthreads : -2 2021-08-20 00:48:41,667 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_cuda_worker_options : --memory-limit 0.95 2021-08-20 00:48:41,669 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_dashboard_port : 8787 2021-08-20 00:48:41,671 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_protocol : tcp 2021-08-20 00:48:41,674 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_retrials_allreduce_empty_issue : 5 2021-08-20 00:48:41,676 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_scheduler_env * : {} 2021-08-20 00:48:41,679 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_scheduler_options : 2021-08-20 00:48:41,682 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_server_ip * : 192.168.254.2 2021-08-20 00:48:41,685 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_server_port : 8786 2021-08-20 00:48:41,689 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_env * : {'NCCL_P2P_DISABLE': '1', 'NCCL_DEBUG': 'WARN'} 2021-08-20 00:48:41,692 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_nprocs : 1 2021-08-20 00:48:41,694 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_nthreads : 1 2021-08-20 00:48:41,697 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dask_worker_options : --memory-limit 0.95 2021-08-20 00:48:41,699 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_import_ignore_file_names : ['_SUCCESS'] 2021-08-20 00:48:41,702 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_ingest_timeout : 86400.0 2021-08-20 00:48:41,704 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_precision : float32 2021-08-20 00:48:41,707 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_recipe_isolate : True 2021-08-20 00:48:41,710 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | data_recipe_preview_num_rows : 20 2021-08-20 00:48:41,713 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | datatable_separator : 2021-08-20 00:48:41,715 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | dbscand_frac_gpu_mem : 0.25 2021-08-20 00:48:41,718 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_custom : False 2021-08-20 00:48:41,721 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_daimodel_level : 0 2021-08-20 00:48:41,725 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_ga : False 2021-08-20 00:48:41,728 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_ga_pickles : False 2021-08-20 00:48:41,731 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_gpu_lock : False 2021-08-20 00:48:41,734 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_gpu_lock2 : False 2021-08-20 00:48:41,736 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_h2o4gpu_level : 0 2021-08-20 00:48:41,739 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_indiv : False 2021-08-20 00:48:41,742 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_log : False 2021-08-20 00:48:41,745 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_pipeline_pickles : False 2021-08-20 00:48:41,748 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | debug_trace : True 2021-08-20 00:48:41,750 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | decision_tree_accuracy_switch : 7 2021-08-20 00:48:41,756 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | decision_tree_interpretability_switch : 7 2021-08-20 00:48:41,759 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_booster : lightgbm 2021-08-20 00:48:41,762 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_global_isolation_pool : True 2021-08-20 00:48:41,765 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_lightgbm_max_bin : 64 2021-08-20 00:48:41,768 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_max_bin : 256 2021-08-20 00:48:41,770 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_max_feature_interaction_depth : 8 2021-08-20 00:48:41,773 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | default_model_class_name : LightGBMModel 2021-08-20 00:48:41,778 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | delete_model_dirs_and_files : True 2021-08-20 00:48:41,790 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | delete_preview_trans_timings : True 2021-08-20 00:48:41,793 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | deployment_aws_bucket_name : 2021-08-20 00:48:41,795 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detailed_skip_failure_messages_level : 1 2021-08-20 00:48:41,798 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detailed_tensorflow_import_error : False 2021-08-20 00:48:41,800 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detailed_traces : False 2021-08-20 00:48:41,802 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detect_features_distribution_shift_threshold_auc : 0.55 2021-08-20 00:48:41,804 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detect_features_leakage_threshold_auc : 0.95 2021-08-20 00:48:41,806 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | detect_features_per_feature_leakage_threshold_auc : 0.8 2021-08-20 00:48:41,809 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | disable_core_files : False 2021-08-20 00:48:41,811 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | disablelogout : False 2021-08-20 00:48:41,816 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | disk_limit_gb : 5 2021-08-20 00:48:41,824 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | do_not_log_list : ['artifacts_git_password', 'auth_jwt_secret', 'auth_openid_client_id', 'auth_openid_client_secret', 'auth_openid_userinfo_auth_key', 'auth_openid_userinfo_auth_value', 'auth_openid_userinfo_username_key', 'auth_tls_ldap_bind_password', 'aws_access_key_id', 'aws_secret_access_key', 'azure_blob_account_key', 'azure_blob_account_name', 'azure_connection_string', 'deployment_aws_access_key_id', 'deployment_aws_secret_access_key', 'gcs_path_to_service_account_json', 'kaggle_key', 'kaggle_username', 'kdb_password', 'kdb_user', 'ldap_bind_password', 'ldap_search_password', 'local_htpasswd_file', 'main_server_minio_access_key_id', 'main_server_minio_secret_access_key', 'main_server_redis_password', 'minio_access_key_id', 'minio_endpoint_url', 'minio_secret_access_key', 'snowflake_account', 'snowflake_password', 'snowflake_url', 'snowflake_user', 'custom_recipe_security_analysis_enabled', 'custom_recipe_import_allowlist', 'custom_recipe_import_banlist', 'custom_recipe_method_call_allowlist', 'custom_recipe_method_call_banlist', 'custom_recipe_dangerous_patterns', 'azure_ad_client_secret', 'azure_blob_keycloak_aad_client_secret', 'artifacts_azure_blob_account_name', 'artifacts_azure_blob_account_key', 'artifacts_azure_connection_string'] 2021-08-20 00:48:41,829 C: 0% D:0B M:0B NODE:LOCAL1 7646 INFO | drop_constant_columns : True 2021-08-20 00:48:41,834 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_constant_model_final_ensemble : True 2021-08-20 00:48:41,841 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_distribution_shift_min_features : 1 2021-08-20 00:48:41,853 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_distribution_shift_threshold_auc : 0.999 2021-08-20 00:48:41,859 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_leakage_min_features : 1 2021-08-20 00:48:41,862 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_features_leakage_threshold_auc : 0.999 2021-08-20 00:48:41,866 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_id_columns : True 2021-08-20 00:48:41,868 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_low_meta_weights : True 2021-08-20 00:48:41,871 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | drop_redundant_columns_limit : 1000 2021-08-20 00:48:41,873 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_classpath : 2021-08-20 00:48:41,876 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_jvm_args : 2021-08-20 00:48:41,878 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_login_user : 2021-08-20 00:48:41,881 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_app_principal_user : 2021-08-20 00:48:41,883 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_auth_type : noauth 2021-08-20 00:48:41,886 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_config_path : 2021-08-20 00:48:41,889 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_init_path : dtap:// 2021-08-20 00:48:41,894 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_key_tab_path : 2021-08-20 00:48:41,896 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dtap_keytab_path : 2021-08-20 00:48:41,900 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dummy : 0 2021-08-20 00:48:41,902 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_every_scored_indiv : True 2021-08-20 00:48:41,905 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_every_scored_indiv_feature_count : 3 2021-08-20 00:48:41,907 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_every_scored_indiv_mutation_count : 3 2021-08-20 00:48:41,910 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_modelparams_separate_files : False 2021-08-20 00:48:41,912 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_trans_timings : False 2021-08-20 00:48:41,914 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | dump_varimp_every_scored_indiv : False 2021-08-20 00:48:41,919 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | early_stopping : True 2021-08-20 00:48:41,922 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | early_stopping_per_individual : True 2021-08-20 00:48:41,924 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | early_stopping_per_individual_spread_mutations : False 2021-08-20 00:48:41,926 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_acceptance_tests : True 2021-08-20 00:48:41,929 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_advanced_features_experiment : False 2021-08-20 00:48:41,931 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_amp_for_speed : False 2021-08-20 00:48:41,934 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_artifacts_upload : False 2021-08-20 00:48:41,936 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_basic_acceptance_tests : True 2021-08-20 00:48:41,938 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_bert_model_acceptance_test : False 2021-08-20 00:48:41,941 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_bert_transformer_acceptance_test : False 2021-08-20 00:48:41,943 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_bootstrap : True 2021-08-20 00:48:41,946 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_cache_final_pipeline : False 2021-08-20 00:48:41,948 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_constant_model : auto 2021-08-20 00:48:41,951 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_datas : True 2021-08-20 00:48:41,954 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_explainers : True 2021-08-20 00:48:41,957 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_models : True 2021-08-20 00:48:41,962 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_pretransformers : True 2021-08-20 00:48:41,967 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes : True 2021-08-20 00:48:41,971 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes_from_url : True 2021-08-20 00:48:41,975 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes_from_zip : True 2021-08-20 00:48:41,980 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_recipes_upload : True 2021-08-20 00:48:41,984 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_scorers : True 2021-08-20 00:48:41,988 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_custom_transformers : True 2021-08-20 00:48:41,991 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_dask_cluster * : False 2021-08-20 00:48:41,995 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_dataset_downloading : True 2021-08-20 00:48:41,999 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_decision_tree : auto 2021-08-20 00:48:42,003 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_experiment_export : True 2021-08-20 00:48:42,006 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_experiment_import : True 2021-08-20 00:48:42,009 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_ftrl : auto 2021-08-20 00:48:42,013 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_genetic_algorithm : auto 2021-08-20 00:48:42,016 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_glm : auto 2021-08-20 00:48:42,019 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_glm_rapids : False 2021-08-20 00:48:42,023 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_gui_product_tour : True 2021-08-20 00:48:42,027 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_h2o4gpu_kmeans : False 2021-08-20 00:48:42,030 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_h2o4gpu_truncatedsvd : False 2021-08-20 00:48:42,033 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_h2o_recipes : True 2021-08-20 00:48:42,036 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_https : False 2021-08-20 00:48:42,039 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_hyperopt_dask : auto 2021-08-20 00:48:42,042 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_imputation : False 2021-08-20 00:48:42,045 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_isolation_forest : off 2021-08-20 00:48:42,049 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lexilabel_encoding : off 2021-08-20 00:48:42,052 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_license_manager : False 2021-08-20 00:48:42,055 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm : auto 2021-08-20 00:48:42,058 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_boosting_types : ['gbdt'] 2021-08-20 00:48:42,061 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_cat_support : False 2021-08-20 00:48:42,063 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_cuda_support : False 2021-08-20 00:48:42,067 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_dask : auto 2021-08-20 00:48:42,070 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_extra_trees : False 2021-08-20 00:48:42,073 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_hyperopt_callback : True 2021-08-20 00:48:42,075 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_import : True 2021-08-20 00:48:42,078 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_linear_tree : False 2021-08-20 00:48:42,081 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_lightgbm_multiclass_balancing : auto 2021-08-20 00:48:42,083 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mapr_multi_user_mode : False 2021-08-20 00:48:42,086 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_async_api : True 2021-08-20 00:48:42,089 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_keeper : True 2021-08-20 00:48:42,092 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_priority_queues : True 2021-08-20 00:48:42,095 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_sa : True 2021-08-20 00:48:42,098 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_sa_main_chart_aggregator : True 2021-08-20 00:48:42,101 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_mli_symlinks : True 2021-08-20 00:48:42,103 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_one_hot_encoding : auto 2021-08-20 00:48:42,106 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_projects : True 2021-08-20 00:48:42,108 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_pytorch : auto 2021-08-20 00:48:42,111 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_pytorch_nlp : auto 2021-08-20 00:48:42,113 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_pytorch_tensorboard_logger : False 2021-08-20 00:48:42,115 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_cuml_models : False 2021-08-20 00:48:42,118 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_models_dask : False 2021-08-20 00:48:42,120 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_transformers : False 2021-08-20 00:48:42,124 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rapids_transformers_dask : False 2021-08-20 00:48:42,126 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_rulefit : auto 2021-08-20 00:48:42,129 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_secure_cookies : False 2021-08-20 00:48:42,131 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_strict_confict_key_check_for_brain : True 2021-08-20 00:48:42,134 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_target_encoding : auto 2021-08-20 00:48:42,136 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow : auto 2021-08-20 00:48:42,139 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_charcnn : auto 2021-08-20 00:48:42,141 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_image : on 2021-08-20 00:48:42,143 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_import : True 2021-08-20 00:48:42,147 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_nlp_accuracy_switch : 5 2021-08-20 00:48:42,150 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_textbigru : auto 2021-08-20 00:48:42,152 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tensorflow_textcnn : auto 2021-08-20 00:48:42,155 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_tf32_for_speed : False 2021-08-20 00:48:42,158 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_torch_import : True 2021-08-20 00:48:42,160 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_wide_rules : auto 2021-08-20 00:48:42,162 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_ws_perfmon : False 2021-08-20 00:48:42,165 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_dart : auto 2021-08-20 00:48:42,167 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_dart_dask : auto 2021-08-20 00:48:42,170 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_gbm : auto 2021-08-20 00:48:42,174 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_gbm_dask : auto 2021-08-20 00:48:42,176 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_hyperopt_callback : True 2021-08-20 00:48:42,178 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_rapids : False 2021-08-20 00:48:42,181 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xgboost_rf : auto 2021-08-20 00:48:42,183 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_xsrf_protection : True 2021-08-20 00:48:42,186 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enable_zero_inflated_models : auto 2021-08-20 00:48:42,189 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | enabled_file_systems * : ['upload', 'file', 'hdfs', 's3', 'recipe_file', 'recipe_url'] 2021-08-20 00:48:42,191 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ensemble_accuracy_switch : 5 2021-08-20 00:48:42,194 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ensemble_meta_learner : blender 2021-08-20 00:48:42,196 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_datas : [] 2021-08-20 00:48:42,199 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_genes : [] 2021-08-20 00:48:42,201 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_mli_explainers : [] 2021-08-20 00:48:42,203 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_models : [] 2021-08-20 00:48:42,206 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_scorers : [] 2021-08-20 00:48:42,208 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | excluded_transformers : [] 2021-08-20 00:48:42,211 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | exclusive_mode : safe 2021-08-20 00:48:42,213 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_anneal_factor : 0.9 2021-08-20 00:48:42,216 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_gene_anneal : True 2021-08-20 00:48:42,219 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_grow_anneal : True 2021-08-20 00:48:42,221 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_anneal : True 2021-08-20 00:48:42,224 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_anneal_factor : 0.9 2021-08-20 00:48:42,226 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_prob0 : 0.5 2021-08-20 00:48:42,229 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_model_prob_lowest : 0.1 2021-08-20 00:48:42,231 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_more_unused_genes : True 2021-08-20 00:48:42,234 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_prob0 : 0.5 2021-08-20 00:48:42,236 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | explore_prob_lowest : 0.1 2021-08-20 00:48:42,239 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | expose_server_version : True 2021-08-20 00:48:42,242 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | extra_http_headers : {} 2021-08-20 00:48:42,244 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | extra_migration_custom_recipes_missing_modules : False 2021-08-20 00:48:42,246 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | extra_mutation_level : -1 2021-08-20 00:48:42,249 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | factor_rf : 1.25 2021-08-20 00:48:42,252 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fair_c_list : [1.0, 0.1, 0.5, 0.9] 2021-08-20 00:48:42,258 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fast_approx_do_one_fold_one_model : True 2021-08-20 00:48:42,261 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fast_approx_num_trees : 50 2021-08-20 00:48:42,263 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_brain_level : 2 2021-08-20 00:48:42,266 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_brain_reset_score : auto 2021-08-20 00:48:42,268 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_brain_save_every_iteration : 0 2021-08-20 00:48:42,271 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_cost_mean_interp_for_penalty : 5 2021-08-20 00:48:42,276 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_engineering_effort : -1 2021-08-20 00:48:42,282 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_engineering_effort_default : 5 2021-08-20 00:48:42,286 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | feature_evolution_data_size : 300000000 2021-08-20 00:48:42,289 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | features_allowed_by_interpretability : {1: 10000000, 2: 10000, 3: 1000, 4: 500, 5: 300, 6: 200, 7: 150, 8: 100, 9: 80, 10: 50, 11: 50, 12: 50, 13: 50} 2021-08-20 00:48:42,292 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | features_cost_per_interp : 0.25 2021-08-20 00:48:42,295 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | features_per_gene : 1 2021-08-20 00:48:42,298 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | file_hide_data_directory : True 2021-08-20 00:48:42,301 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | file_path_filter_include : [] 2021-08-20 00:48:42,306 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | file_path_filtering_enabled : False 2021-08-20 00:48:42,309 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | files_without_extensions_expected_types : ['parquet', 'orc'] 2021-08-20 00:48:42,312 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | final_pipeline_data_size : 1000000000 2021-08-20 00:48:42,315 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | final_vs_ga_progress_factor : 5 2021-08-20 00:48:42,318 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_ensemble_level : -1 2021-08-20 00:48:42,321 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_feature_interaction_depth : 0 2021-08-20 00:48:42,324 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_feature_interaction_depth_many_inputs_generates_not_useful : 0 2021-08-20 00:48:42,327 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_fold_reps : 0 2021-08-20 00:48:42,329 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_max_nestimators : -1 2021-08-20 00:48:42,333 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_num_folds : -1 2021-08-20 00:48:42,336 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_num_folds_evolution : -1 2021-08-20 00:48:42,339 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_num_individuals : 0 2021-08-20 00:48:42,342 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_only_first_fold_model : auto 2021-08-20 00:48:42,345 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixed_split_seed : 0 2021-08-20 00:48:42,348 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixup_infX : True 2021-08-20 00:48:42,352 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fixup_nanpreds : True 2021-08-20 00:48:42,354 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fold_balancing_repeats_times_rows : 100000000.0 2021-08-20 00:48:42,357 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fold_reps : 1 2021-08-20 00:48:42,360 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fold_scores_instability_warning_threshold : 0.25 2021-08-20 00:48:42,363 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | folds_for_group_by : 5 2021-08-20 00:48:42,366 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | force_model_restart_to_defaults : True 2021-08-20 00:48:42,369 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | force_stratified_splits_for_imbalanced_threshold_binary : 0.01 2021-08-20 00:48:42,372 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | force_use_global_isolation_pool : False 2021-08-20 00:48:42,375 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fraction_anchor_reduce_features_when_failure : 0.1 2021-08-20 00:48:42,378 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fraction_std_bootstrap_ladder_factor : 0.01 2021-08-20 00:48:42,381 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fresh_indiv_accuracy_switch : 7 2021-08-20 00:48:42,383 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_data_frac : 0.5 2021-08-20 00:48:42,386 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_data_vary_for_interpretability : 7 2021-08-20 00:48:42,389 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_interpretabilty_switch : 7 2021-08-20 00:48:42,392 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_cols_selected : 10000000 2021-08-20 00:48:42,395 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_cols_selected_simple_factor : 2 2021-08-20 00:48:42,398 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_nonnumeric_cols_selected : 200 2021-08-20 00:48:42,401 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_orig_numeric_cols_selected : 10000000 2021-08-20 00:48:42,404 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | fs_prune_by_genes : False 2021-08-20 00:48:42,415 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ftrl_max_interaction_terms_per_degree : 10000 2021-08-20 00:48:42,424 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | full_cv_accuracy_switch : 8 2021-08-20 00:48:42,427 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gbm_early_stopping_rounds_max : 10000000000 2021-08-20 00:48:42,430 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gbm_early_stopping_rounds_min : 1 2021-08-20 00:48:42,432 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gcs_init_path : gs:// 2021-08-20 00:48:42,435 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | get_url_data_sleep : 5 2021-08-20 00:48:42,437 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | get_url_data_trials : 5 2021-08-20 00:48:42,440 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_accuracy_switch : 5 2021-08-20 00:48:42,442 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_do_lambda_search : True 2021-08-20 00:48:42,445 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_do_lambda_search_by_eval_metric : False 2021-08-20 00:48:42,448 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_interpretability_switch : 6 2021-08-20 00:48:42,453 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_lambda_early_stopping_rounds : 4 2021-08-20 00:48:42,456 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_nan_impute_prediction_data : True 2021-08-20 00:48:42,458 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_nan_impute_training_data : False 2021-08-20 00:48:42,461 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_nan_impute_validation_data : False 2021-08-20 00:48:42,464 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | glm_optimal_refit : True 2021-08-20 00:48:42,467 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_id_start : 0 2021-08-20 00:48:42,469 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_data_size : 0 2021-08-20 00:48:42,472 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_delay : 10.0 2021-08-20 00:48:42,478 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_min_delay : 0.0 2021-08-20 00:48:42,480 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_lock_safety_factor : 3 2021-08-20 00:48:42,483 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_locking_free_dead : True 2021-08-20 00:48:42,485 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_locking_trust_pool_submission : True 2021-08-20 00:48:42,489 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_locking_type : global 2021-08-20 00:48:42,492 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gpu_small_data_size : 100000 2021-08-20 00:48:42,494 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_anneal_factor : 0.5 2021-08-20 00:48:42,497 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_prob0 : 0.8 2021-08-20 00:48:42,500 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_prob_lowest : 0.05 2021-08-20 00:48:42,503 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | grow_proboff : 0.5 2021-08-20 00:48:42,511 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gui_enable_deploy_button : True 2021-08-20 00:48:42,513 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | gui_require_experiment_name : False 2021-08-20 00:48:42,516 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_mli_fraction_memory : 0.45 2021-08-20 00:48:42,519 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_mli_nthreads * : 8 2021-08-20 00:48:42,521 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_ip : None 2021-08-20 00:48:42,524 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_kwargs * : {} 2021-08-20 00:48:42,527 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_log_level : None 2021-08-20 00:48:42,530 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_max_mem_size : None 2021-08-20 00:48:42,532 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_min_mem_size : None 2021-08-20 00:48:42,535 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_name * : None 2021-08-20 00:48:42,537 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_nthreads : 8 2021-08-20 00:48:42,540 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_port * : 50361 2021-08-20 00:48:42,544 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_start_sleep : 5 2021-08-20 00:48:42,547 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_start_sleep0 : 1 2021-08-20 00:48:42,550 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_start_trials : 5 2021-08-20 00:48:42,553 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_recipes_url : None 2021-08-20 00:48:42,556 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_address : 2021-08-20 00:48:42,560 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_internal_default_project_id : 2021-08-20 00:48:42,562 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_oauth2_scopes : 2021-08-20 00:48:42,565 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_projects_enabled : False 2021-08-20 00:48:42,568 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_rpc_bytestream_deadline_seconds : 7200 2021-08-20 00:48:42,571 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_rpc_deadline_seconds : 60 2021-08-20 00:48:42,573 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_ca_path : 2021-08-20 00:48:42,578 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_cert_path : 2021-08-20 00:48:42,580 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_enabled : True 2021-08-20 00:48:42,583 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | h2o_storage_tls_key_path : 2021-08-20 00:48:42,585 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_classpath : 2021-08-20 00:48:42,588 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_jvm_args : 2021-08-20 00:48:42,591 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_login_user : 2021-08-20 00:48:42,593 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_principal_user : 2021-08-20 00:48:42,597 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_app_supported_schemes : ['hdfs://', 'maprfs://', 'swift://'] 2021-08-20 00:48:42,600 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_auth_type : noauth 2021-08-20 00:48:42,602 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_init_path : hdfs:// 2021-08-20 00:48:42,605 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hdfs_max_files_listed : 100 2021-08-20 00:48:42,608 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | heavy_imbalance_ratio_multiclass_threshold : 25 2021-08-20 00:48:42,610 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | heavy_imbalance_ratio_sampling_threshold : 25 2021-08-20 00:48:42,613 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | high_correlation_value_to_report : 0.95 2021-08-20 00:48:42,616 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hive_app_classpath : 2021-08-20 00:48:42,620 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hive_app_configs : {} 2021-08-20 00:48:42,623 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hive_app_jvm_args : -Xmx4g 2021-08-20 00:48:42,626 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | honor_datatable_precision : False 2021-08-20 00:48:42,629 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | huber_alpha_list : [0.9, 0.3, 0.5, 0.6, 0.7, 0.8, 0.1, 0.99] 2021-08-20 00:48:42,631 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hyperopt_shift_leak : False 2021-08-20 00:48:42,634 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | hyperopt_shift_leak_per_column : False 2021-08-20 00:48:42,637 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ignore_package_version : [] 2021-08-20 00:48:42,640 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | image_download_timeout : 60 2021-08-20 00:48:42,643 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | image_paths_absolute : False 2021-08-20 00:48:42,645 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_ratio_multiclass_threshold : 5 2021-08-20 00:48:42,648 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_ratio_notification_threshold : 2.0 2021-08-20 00:48:42,650 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_ratio_sampling_threshold : 5 2021-08-20 00:48:42,653 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_max_multiple_data_size : 1.0 2021-08-20 00:48:42,657 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_max_number_of_bags : 10 2021-08-20 00:48:42,661 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_max_number_of_bags_feature_evolution : 3 2021-08-20 00:48:42,664 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_method : off 2021-08-20 00:48:42,666 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_number_of_bags : -1 2021-08-20 00:48:42,669 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_rank_averaging : auto 2021-08-20 00:48:42,671 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_target_minority_fraction : -1.0 2021-08-20 00:48:42,674 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | imbalance_sampling_threshold_min_rows_original : 100000 2021-08-20 00:48:42,676 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | include_all_as_pretransformers_if_none_selected : False 2021-08-20 00:48:42,681 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | include_custom_recipes_by_default : False 2021-08-20 00:48:42,684 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_datas : [] 2021-08-20 00:48:42,686 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_models * : ['LightGBMModel'] 2021-08-20 00:48:42,689 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_pretransformers : [] 2021-08-20 00:48:42,694 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_scorers * : ['ACCURACY', 'AUC', 'AUCPR', 'CALINSKIHARABASZ', 'DAVIESBOULDIN', 'F05', 'F1', 'F2', 'FDR', 'FNR', 'FOR', 'FPR', 'GINI', 'LOGLOSS', 'MACROAUC', 'MACROF1', 'MACROMCC', 'MAE', 'MAPE', 'MCC', 'MER', 'MSE', 'NPV', 'PRECISION', 'R2', 'R2COD', 'RECALL', 'RMSE', 'RMSLE', 'RMSPE', 'SILHOUETTE', 'SMAPE', 'TNR', 'UNSUPERVISED'] 2021-08-20 00:48:42,696 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | included_transformers * : ['BERTTransformer', 'CVCatNumEncodeTransformer', 'CVTECUMLTransformer', 'CVTargetEncodeTransformer', 'CatOriginalTransformer', 'CatTransformer', 'ClusterDistCUMLDaskTransformer', 'ClusterDistCUMLTransformer', 'ClusterDistTransformer', 'ClusterIdAllNumTransformer', 'ClusterTETransformer', 'DBSCANCUMLDaskTransformer', 'DBSCANCUMLTransformer', 'DateOriginalTransformer', 'DateTimeDiffTransformer', 'DateTimeOriginalTransformer', 'DatesTransformer', 'EwmaLagsTransformer', 'FrequentTransformer', 'ImageOriginalTransformer', 'ImageVectorizerTransformer', 'InteractionsTransformer', 'IsHolidayTransformer', 'IsolationForestAnomalyAllNumericTransformer', 'IsolationForestAnomalyNumCatAllColsTransformer', 'IsolationForestAnomalyNumCatTransformer', 'IsolationForestAnomalyNumericTransformer', 'LagsAggregatesTransformer', 'LagsInteractionTransformer', 'LagsTransformer', 'LexiLabelEncoderTransformer', 'MeanTargetTransformer', 'NumCatTETransformer', 'NumToCatTETransformer', 'NumToCatWoEMonotonicTransformer', 'NumToCatWoETransformer', 'OneHotEncodingTransformer', 'OriginalTransformer', 'RawTransformer', 'StandardScalerTransformer', 'StringConcatTransformer', 'TSNECUMLTransformer', 'TextBiGRUTransformer', 'TextCNNTransformer', 'TextCharCNNTransformer', 'TextLinModelTransformer', 'TextOriginalTransformer', 'TextTransformer', 'TimeSeriesTargetEncTransformer', 'TruncSVDAllNumTransformer', 'TruncSVDCUMLDaskTransformer', 'TruncSVDCUMLTransformer', 'TruncSVDNumTransformer', 'UMAPCUMLDaskTransformer', 'UMAPCUMLTransformer', 'WeightOfEvidenceTransformer'] 2021-08-20 00:48:42,699 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | inject_mojo_for_predictions : True 2021-08-20 00:48:42,701 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_corr_threshold : 0.95 2021-08-20 00:48:42,704 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_gini_rel_improvement_threshold : 0.5 2021-08-20 00:48:42,712 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_max_pairwise_interactions : 100 2021-08-20 00:48:42,714 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_max_rows_x_cols : 200000.0 2021-08-20 00:48:42,717 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_return_limit : 5 2021-08-20 00:48:42,720 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | interaction_finder_search_limit : 20 2021-08-20 00:48:42,722 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | isolation_forest_nestimators : 200 2021-08-20 00:48:42,725 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | jdbc_app_classpath : 2021-08-20 00:48:42,727 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | jdbc_app_configs : {} 2021-08-20 00:48:42,730 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | jdbc_app_jvm_args : -Xmx4g 2021-08-20 00:48:42,733 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kaggle_competitions : 2021-08-20 00:48:42,735 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kaggle_keep_submission : False 2021-08-20 00:48:42,738 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kaggle_timeout : 120 2021-08-20 00:48:42,740 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_app_classpath : 2021-08-20 00:48:42,744 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_app_jvm_args : 2021-08-20 00:48:42,746 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_hostname : 2021-08-20 00:48:42,749 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | kdb_port : 2021-08-20 00:48:42,752 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | keep_fraction_default : 1.0 2021-08-20 00:48:42,755 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | klime_alpha : 0.0 2021-08-20 00:48:42,758 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | klime_lambda : [1e-06, 1e-08] 2021-08-20 00:48:42,761 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | last_recipe * : auto 2021-08-20 00:48:42,763 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_base_dn : 2021-08-20 00:48:42,766 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_base_filter : 2021-08-20 00:48:42,769 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_bind_dn : 2021-08-20 00:48:42,778 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_dc : 2021-08-20 00:48:42,780 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_ou_dn : 2021-08-20 00:48:42,784 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_port : 2021-08-20 00:48:42,788 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_recipe : 0 2021-08-20 00:48:42,791 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_attributes : 2021-08-20 00:48:42,793 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_base : 2021-08-20 00:48:42,796 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_filter : 2021-08-20 00:48:42,799 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_search_user_id : 2021-08-20 00:48:42,801 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_server : 2021-08-20 00:48:42,804 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_tls_file : 2021-08-20 00:48:42,807 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_use_ssl : False 2021-08-20 00:48:42,810 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_user_name_attribute : 2021-08-20 00:48:42,813 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | ldap_user_prefix : 2021-08-20 00:48:42,817 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_check_reduced_features : True 2021-08-20 00:48:42,820 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_check_text : True 2021-08-20 00:48:42,823 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_key_features_varimp : 0.001 2021-08-20 00:48:42,826 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_key_features_varimp_if_no_early_stopping : 0.05 2021-08-20 00:48:42,829 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_max_bin : 256 2021-08-20 00:48:42,832 C: 29% D:996.4GB M:246.0GB NODE:LOCAL1 7646 INFO | leakage_max_data_size : 10000000 2021-08-20 00:48:42,836 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_max_max_depth : 8 2021-08-20 00:48:42,842 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_min_max_depth : 6 2021-08-20 00:48:42,843 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_train_test_split : 0.25 2021-08-20 00:48:42,845 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | leakage_trees : 100 2021-08-20 00:48:42,848 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_address : http://127.0.0.1:9999 2021-08-20 00:48:42,851 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_dry_run_token : 2021-08-20 00:48:42,854 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_lease_duration : 3600000 2021-08-20 00:48:42,857 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_project_name : default 2021-08-20 00:48:42,860 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_ssl_certs : true 2021-08-20 00:48:42,863 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_worker_lease_duration : 21600000 2021-08-20 00:48:42,867 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | license_manager_worker_startup_timeout : 3600000 2021-08-20 00:48:42,870 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_accuracy_switch : 1 2021-08-20 00:48:42,872 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_binary_metrics : ['binary', 'binary', 'auc'] 2021-08-20 00:48:42,875 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_binary_objectives : ['binary', 'xentropy'] 2021-08-20 00:48:42,878 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_interpretability_switch : 10 2021-08-20 00:48:42,882 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_listen_port : 12400 2021-08-20 00:48:42,885 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_monotone_constraints_method : intermediate 2021-08-20 00:48:42,897 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_monotone_penalty : 0.0 2021-08-20 00:48:42,900 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_multi_metrics : ['multiclass', 'multi_error'] 2021-08-20 00:48:42,904 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_reduce_on_errors_list : ['Out of Host Memory'] 2021-08-20 00:48:42,907 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_reg_metrics : ['rmse', 'mse', 'mae'] 2021-08-20 00:48:42,911 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lightgbm_reg_objectives : ['mse', 'mae'] 2021-08-20 00:48:42,915 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | limit_features_by_interpretability : True 2021-08-20 00:48:42,918 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | limit_nofile : 65535 2021-08-20 00:48:42,921 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | limit_nproc : 16384 2021-08-20 00:48:42,927 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | list_files_without_extensions : False 2021-08-20 00:48:42,930 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | local_minio_port : 9001 2021-08-20 00:48:42,933 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_fit_info : True 2021-08-20 00:48:42,935 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_level : 1 2021-08-20 00:48:42,939 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_predict_info : True 2021-08-20 00:48:42,942 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | log_system_info_per_experiment : True 2021-08-20 00:48:42,945 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | logit_value_unseen : -100 2021-08-20 00:48:42,948 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lossguide_drop_factor : 4.0 2021-08-20 00:48:42,951 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lossguide_max_depth_extend_factor : 8.0 2021-08-20 00:48:42,954 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | lowest_nonzero_varimp : 1e-30 2021-08-20 00:48:42,957 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_minio_address * : 127.0.0.1:9001 2021-08-20 00:48:42,960 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_minio_bucket * : h2oai 2021-08-20 00:48:42,964 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_minio_bucket_ping_timeout : 30 2021-08-20 00:48:42,967 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | main_server_redis_ping_timeout : 5 2021-08-20 00:48:42,970 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_autoreport : True 2021-08-20 00:48:42,973 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_mojo_scoring_pipeline : auto 2021-08-20 00:48:42,976 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_pipeline_visualization : auto 2021-08-20 00:48:42,979 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | make_python_scoring_pipeline : auto 2021-08-20 00:48:42,983 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | many_columns_count : 400 2021-08-20 00:48:42,986 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_abs_score_delta_train_valid : 0.0 2021-08-20 00:48:42,990 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_absolute_cardinality : 1000000 2021-08-20 00:48:42,993 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_absolute_feature_expansion : 1000 2021-08-20 00:48:42,996 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_bootstrap_sample_size_factor : 10.0 2021-08-20 00:48:43,002 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_bootstrap_samples : 100 2021-08-20 00:48:43,005 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols : 10000000 2021-08-20 00:48:43,008 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_gui_headtail : 1000 2021-08-20 00:48:43,011 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_log_headtail : 1000 2021-08-20 00:48:43,014 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_make_autoreport_automatically : 1000 2021-08-20 00:48:43,017 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_make_pipeline_visualization_automatically : 5000 2021-08-20 00:48:43,020 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_show_feature_transformer_mapping : 1000 2021-08-20 00:48:43,023 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cols_show_unused_features : 1000 2021-08-20 00:48:43,026 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores : 0 2021-08-20 00:48:43,028 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores_by_physical : True 2021-08-20 00:48:43,032 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores_dai : -1 2021-08-20 00:48:43,035 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_cores_limit : 100 2021-08-20 00:48:43,038 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_debug_description_length : 1000 2021-08-20 00:48:43,041 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_do_timeseries_split_suggestion : 1 2021-08-20 00:48:43,044 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_munging : -1 2021-08-20 00:48:43,047 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_readwrite : -1 2021-08-20 00:48:43,050 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_dt_threads_stats_openblas : -1 2021-08-20 00:48:43,053 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_epochs : 10 2021-08-20 00:48:43,056 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_feature_interaction_depth : -1 2021-08-20 00:48:43,059 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_features_importance : 100000 2021-08-20 00:48:43,062 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_features_importance_debug : 1000 2021-08-20 00:48:43,065 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_files_listed : 100 2021-08-20 00:48:43,068 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fit_cores : 10 2021-08-20 00:48:43,071 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fit_cores_override : 0 2021-08-20 00:48:43,074 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fold_balancing_repeats : 10 2021-08-20 00:48:43,077 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_fraction_invalid_numeric : -1.0 2021-08-20 00:48:43,080 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_int_as_cat_uniques : 50 2021-08-20 00:48:43,083 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_learning_rate : 0.5 2021-08-20 00:48:43,086 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_learning_rate_final : 0.05 2021-08-20 00:48:43,099 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_bin : 256 2021-08-20 00:48:43,103 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_depth : 12 2021-08-20 00:48:43,106 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_dt_threads_munging : 4 2021-08-20 00:48:43,115 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_dt_threads_readwrite : 4 2021-08-20 00:48:43,118 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_max_dt_threads_stats_openblas : 8 2021-08-20 00:48:43,121 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_nestimators : 3000 2021-08-20 00:48:43,125 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_nestimators_feature_evolution_factor : 0.2 2021-08-20 00:48:43,129 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_brain_indivs : 3 2021-08-20 00:48:43,132 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_brain_indivs_from_pop : 10000 2021-08-20 00:48:43,135 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes : 200 2021-08-20 00:48:43,138 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes_client_and_gui : 10 2021-08-20 00:48:43,142 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes_compute_roc : 200 2021-08-20 00:48:43,146 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_classes_hard_limit : 10000 2021-08-20 00:48:43,149 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_varimp_shift_to_log : 10 2021-08-20 00:48:43,152 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_num_varimp_to_log : 10 2021-08-20 00:48:43,158 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_cols_selected : 10000000 2021-08-20 00:48:43,161 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_cols_selected_simple_factor : 2 2021-08-20 00:48:43,164 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_nonnumeric_cols_selected : 300 2021-08-20 00:48:43,167 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_orig_numeric_cols_selected : 10000000 2021-08-20 00:48:43,170 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_output_features_per_transformer : 10000 2021-08-20 00:48:43,174 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_predict_cores : 0 2021-08-20 00:48:43,177 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_predict_cores_in_dai : 4 2021-08-20 00:48:43,180 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rel_score_delta_train_valid : 0.0 2021-08-20 00:48:43,184 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_relative_cardinality : 0.95 2021-08-20 00:48:43,187 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_relative_cols_mismatch_allowed : 0.5 2021-08-20 00:48:43,191 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_cm_ga : 500000 2021-08-20 00:48:43,194 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_col_stats : 1000000 2021-08-20 00:48:43,198 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_constant_model : 1000000 2021-08-20 00:48:43,201 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_cv_in_cv_gini : 100000 2021-08-20 00:48:43,205 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_blender : 1000000 2021-08-20 00:48:43,218 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_ensemble_base_model_fold_scores : 1000000 2021-08-20 00:48:43,222 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_holdout_bootstrap_score : 1000000 2021-08-20 00:48:43,233 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_holdout_score : 5000000 2021-08-20 00:48:43,237 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_roccmconf : 1000000 2021-08-20 00:48:43,240 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_final_train_score : 5000000 2021-08-20 00:48:43,243 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_fs : 500000 2021-08-20 00:48:43,248 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_leak : 100000 2021-08-20 00:48:43,253 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_rows_tuning : 1000 2021-08-20 00:48:43,256 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_runtime_minutes : 1440 2021-08-20 00:48:43,259 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_runtime_minutes_until_abort : 10080 2021-08-20 00:48:43,261 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_validation_to_training_size_ratio_for_final_ensemble : 2.0 2021-08-20 00:48:43,264 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_varimp_to_save : 100 2021-08-20 00:48:43,267 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_workers : 1 2021-08-20 00:48:43,270 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_workers_fs : 0 2021-08-20 00:48:43,273 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | max_workers_shift_leak : 0 2021-08-20 00:48:43,277 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | memory_limit_gb : 5 2021-08-20 00:48:43,279 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | memory_ref : 137438953472 2021-08-20 00:48:43,282 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | memory_score_factor_ref : 0.2 2021-08-20 00:48:43,285 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | merge_dup_raw_features : True 2021-08-20 00:48:43,288 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | meta_weight_allowed_by_interpretability : {1: 1E-7, 2: 1E-5, 3: 1E-4, 4: 1E-3, 5: 1E-2, 6: 0.03, 7: 0.05, 8: 0.08, 9: 0.10, 10: 0.15, 11: 0.15, 12: 0.15, 13: 0.15} 2021-08-20 00:48:43,290 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | meta_weight_allowed_for_reference : 1.0 2021-08-20 00:48:43,293 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_bootstrap_sample_size_factor : 1.0 2021-08-20 00:48:43,296 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_bootstrap_samples : 1 2021-08-20 00:48:43,299 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_dai_iterations : 0 2021-08-20 00:48:43,302 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_dt_threads_final_munging : 1 2021-08-20 00:48:43,308 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_dt_threads_munging : 1 2021-08-20 00:48:43,313 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_learning_rate : 0.05 2021-08-20 00:48:43,318 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_learning_rate_final : 0.01 2021-08-20 00:48:43,323 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_max_bin : 32 2021-08-20 00:48:43,328 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_num_cores_per_gpu : 2 2021-08-20 00:48:43,333 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_num_rows : 100 2021-08-20 00:48:43,338 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_roc_sample_size : 1 2021-08-20 00:48:43,342 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_rows_per_class : 5 2021-08-20 00:48:43,346 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | min_rows_per_split : 5 2021-08-20 00:48:43,350 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | minio_connector_cert_location : 2021-08-20 00:48:43,355 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | minio_init_path : / 2021-08-20 00:48:43,359 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | minio_skip_cert_verification : False 2021-08-20 00:48:43,363 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | missing_values * : ['', '?', 'None', 'nan', 'NA', 'N/A', 'unknown', 'inf', '-inf', '1.7976931348623157e+308', '-1.7976931348623157e+308'] 2021-08-20 00:48:43,366 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_batch_size : 10000 2021-08-20 00:48:43,369 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_cloud_name * : H2O-MLI-DAI-20500 2021-08-20 00:48:43,372 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_custom : 2021-08-20 00:48:43,375 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_default_max_cardinality : 10 2021-08-20 00:48:43,378 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_default_min_cardinality : 2 2021-08-20 00:48:43,382 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_fast_approx : False 2021-08-20 00:48:43,386 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dia_sample_size : 100000 2021-08-20 00:48:43,389 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_drf_max_depth : 20 2021-08-20 00:48:43,392 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_drf_num_trees : 100 2021-08-20 00:48:43,395 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_dt_nthreads : 4 2021-08-20 00:48:43,398 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_enable_mojo_scorer : True 2021-08-20 00:48:43,402 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_fast_approx : True 2021-08-20 00:48:43,405 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_ice_per_bin_strategy : False 2021-08-20 00:48:43,408 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_interpreter_status_cache_size : 1000 2021-08-20 00:48:43,411 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_l1_reg : aic 2021-08-20 00:48:43,414 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_max_runtime : 900 2021-08-20 00:48:43,417 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_nsamples : auto 2021-08-20 00:48:43,420 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_sample : True 2021-08-20 00:48:43,423 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_sample_size : 1000 2021-08-20 00:48:43,426 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_kernel_explainer_workers : 4 2021-08-20 00:48:43,429 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_lime_method : k-LIME 2021-08-20 00:48:43,432 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_max_number_cluster_vars : 6 2021-08-20 00:48:43,443 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_max_numeric_enum_cardinality : 25 2021-08-20 00:48:43,449 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_max_surrogate_retries : 5 2021-08-20 00:48:43,453 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nfolds : 3 2021-08-20 00:48:43,458 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_append_to_english_stop_words : False 2021-08-20 00:48:43,465 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_loco_max_features : -1 2021-08-20 00:48:43,470 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_max_df : 0.9 2021-08-20 00:48:43,473 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_max_ngram : 1 2021-08-20 00:48:43,484 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_min_df : 3 2021-08-20 00:48:43,487 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_min_ngram : 1 2021-08-20 00:48:43,491 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_min_token_mode : top 2021-08-20 00:48:43,494 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_sample_limit : 10000 2021-08-20 00:48:43,498 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_stop_words : english 2021-08-20 00:48:43,501 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_surrogate_tokenizer : Linear Model + TF-IDF 2021-08-20 00:48:43,504 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_surrogate_tokens : 100 2021-08-20 00:48:43,506 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_tokenizer : tfidf 2021-08-20 00:48:43,509 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_tokenizer_max_features : -1 2021-08-20 00:48:43,512 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_top_n : 20 2021-08-20 00:48:43,516 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_nlp_use_stop_words : True 2021-08-20 00:48:43,519 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_num_quantiles : 10 2021-08-20 00:48:43,522 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_pd_numcat_num_chart : True 2021-08-20 00:48:43,525 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_pd_numcat_threshold : 11 2021-08-20 00:48:43,528 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_pd_sample_size : 25000 2021-08-20 00:48:43,534 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_predict_safe : False 2021-08-20 00:48:43,538 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_qbin_count : 0 2021-08-20 00:48:43,541 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_run_kernel_explainer : False 2021-08-20 00:48:43,545 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sa_main_chart_aggregator_limit : 1000 2021-08-20 00:48:43,548 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sa_sampling_limit : 500000 2021-08-20 00:48:43,552 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample : True 2021-08-20 00:48:43,556 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_above_for_scoring : 1000000 2021-08-20 00:48:43,559 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_above_for_training : 100000 2021-08-20 00:48:43,562 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_size : 100000 2021-08-20 00:48:43,566 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sample_training : True 2021-08-20 00:48:43,568 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_sequential_task_execution : True 2021-08-20 00:48:43,571 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_shapley_sample_size : 100000 2021-08-20 00:48:43,575 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_strict_version_check : True 2021-08-20 00:48:43,578 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_use_raw_features : True 2021-08-20 00:48:43,581 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mli_vars_to_pdp : 10 2021-08-20 00:48:43,585 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | model_class_name_for_fs_permute : auto 2021-08-20 00:48:43,588 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_acceptance_test_atol : 0.0 2021-08-20 00:48:43,592 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_acceptance_test_rtol : 0.0 2021-08-20 00:48:43,595 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_building_parallelism : -1 2021-08-20 00:48:43,598 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_building_timeout : 1800.0 2021-08-20 00:48:43,602 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions : auto 2021-08-20 00:48:43,605 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_batch_size : 100 2021-08-20 00:48:43,608 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_benchmark : False 2021-08-20 00:48:43,612 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_benchmark_slower_than_python_threshold : 10 2021-08-20 00:48:43,616 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_max_rows : 10000 2021-08-20 00:48:43,620 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_text : False 2021-08-20 00:48:43,625 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_tf : False 2021-08-20 00:48:43,629 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_for_predictions_torch : False 2021-08-20 00:48:43,634 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mojo_mini_acceptance_test_num_rows : 15 2021-08-20 00:48:43,638 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_correlation_threshold : 0.1 2021-08-20 00:48:43,647 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_dict * : {} 2021-08-20 00:48:43,651 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_drop_low_correlation_features : False 2021-08-20 00:48:43,656 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_interpretability_switch : 7 2021-08-20 00:48:43,660 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_constraints_log_level : medium 2021-08-20 00:48:43,663 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | monotonicity_max_cols : 300 2021-08-20 00:48:43,667 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | munging_report_period : 10 2021-08-20 00:48:43,671 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mutation_mode : sample 2021-08-20 00:48:43,679 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | mutation_rate : -1 2021-08-20 00:48:43,683 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | n_estimators_list_no_early_stopping : [50, 100, 150, 200, 250, 300] 2021-08-20 00:48:43,687 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nbins_ftrl_list : [1000000, 10000000, 100000000] 2021-08-20 00:48:43,691 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | new_mli_list_only_explainable_datasets : False 2021-08-20 00:48:43,695 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_max : -1 2021-08-20 00:48:43,698 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_max_factor : 1.0 2021-08-20 00:48:43,702 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_max_threshold : 200 2021-08-20 00:48:43,705 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | nfeatures_min : -1 2021-08-20 00:48:43,709 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | ngenes_max : -1 2021-08-20 00:48:43,712 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | ngenes_min : -1 2021-08-20 00:48:43,718 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | no_drop_features : False 2021-08-20 00:48:43,721 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | notify_failures : True 2021-08-20 00:48:43,725 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_actuals_vs_predicted : 100 2021-08-20 00:48:43,728 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_as_cat : True 2021-08-20 00:48:43,732 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_cpu_sockets : 1 2021-08-20 00:48:43,736 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_cpu_sockets_override : 0 2021-08-20 00:48:43,741 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_ensemble_folds : 5 2021-08-20 00:48:43,745 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_fold_ids_show : 10 2021-08-20 00:48:43,748 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_folds : 3 2021-08-20 00:48:43,757 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_for_prediction : 0 2021-08-20 00:48:43,760 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_override : -1 2021-08-20 00:48:43,763 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_per_experiment : -1 2021-08-20 00:48:43,765 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_per_hyperopt_dask : -1 2021-08-20 00:48:43,768 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_gpus_per_model : 1 2021-08-20 00:48:43,771 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_hyperopt_individuals_final : -1 2021-08-20 00:48:43,774 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_individuals : 2 2021-08-20 00:48:43,778 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_inner_hyperopt_trials_final : 0 2021-08-20 00:48:43,781 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_inner_hyperopt_trials_prefinal : 0 2021-08-20 00:48:43,784 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_pipeline_layers : 1 2021-08-20 00:48:43,788 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_rows_acceptance_test_custom_model : 100 2021-08-20 00:48:43,792 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_rows_acceptance_test_custom_transformer : 200 2021-08-20 00:48:43,795 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | num_transformed_features_per_pipeline_show : 10 2021-08-20 00:48:43,799 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | number_of_texts_to_cache_in_bert_transformer : -1 2021-08-20 00:48:43,802 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_authorize_url : 2021-08-20 00:48:43,805 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_client_id : 2021-08-20 00:48:43,809 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_enabled : False 2021-08-20 00:48:43,812 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_introspection_url : 2021-08-20 00:48:43,817 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_redirect_url : 2021-08-20 00:48:43,820 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_scope : openid profile ai.h2o.storage 2021-08-20 00:48:43,826 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | oauth2_client_tokens_token_url : 2021-08-20 00:48:43,829 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | ohe_bin_list : [10, 25, 50, 75, 100] 2021-08-20 00:48:43,833 C: 33% D:996.4GB M:245.1GB NODE:LOCAL1 7646 INFO | one_hot_encoding_cardinality_limiter : True 2021-08-20 00:48:43,837 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | one_hot_encoding_cardinality_threshold : 50 2021-08-20 00:48:43,845 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_pruner : MedianPruner 2021-08-20 00:48:43,847 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_pruner_kwargs * : {'n_startup_trials': 5, 'n_warmup_steps': 20, 'interval_steps': 20, 'percentile': 25.0, 'min_resource': 'auto', 'reduction_factor': 4, 'min_early_stopping_rate': 0, 'n_brackets': 4, 'min_early_stopping_rate_low': 0, 'upper': 1.0, 'lower': 0.0} 2021-08-20 00:48:43,849 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_sampler : TPESampler 2021-08-20 00:48:43,855 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | optuna_sampler_kwargs * : {} 2021-08-20 00:48:43,859 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | orig_features_fs_report : False 2021-08-20 00:48:43,862 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | orig_stddev_max_cols : 1000 2021-08-20 00:48:43,866 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | parameter_tuning_num_models : -1 2021-08-20 00:48:43,869 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_dart * : {} 2021-08-20 00:48:43,871 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_decision_tree * : {} 2021-08-20 00:48:43,874 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_ftrl * : {} 2021-08-20 00:48:43,877 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_gblinear * : {} 2021-08-20 00:48:43,880 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_lightgbm * : {} 2021-08-20 00:48:43,883 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_rulefit * : {} 2021-08-20 00:48:43,886 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tensorflow * : {} 2021-08-20 00:48:43,888 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_dart * : {} 2021-08-20 00:48:43,891 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_ftrl * : {} 2021-08-20 00:48:43,894 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_gblinear * : {} 2021-08-20 00:48:43,897 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_grow_policy_simple_trees : True 2021-08-20 00:48:43,900 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_lightgbm * : {} 2021-08-20 00:48:43,903 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_rulefit * : {} 2021-08-20 00:48:43,905 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_tensorflow * : {} 2021-08-20 00:48:43,909 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_tune_xgboost * : {} 2021-08-20 00:48:43,912 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | params_xgboost * : {} 2021-08-20 00:48:43,915 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pass_env_to_deprecated_python_scoring : False 2021-08-20 00:48:43,917 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pdp_max_threads : -1 2021-08-20 00:48:43,920 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | per_user_directories : True 2021-08-20 00:48:43,924 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | performance_threshold_data_size_large : 100000000 2021-08-20 00:48:43,927 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | performance_threshold_data_size_small : 100000 2021-08-20 00:48:43,930 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | perturb_xgb_depth_max : 10 2021-08-20 00:48:43,933 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | perturb_xgb_depth_min : 3 2021-08-20 00:48:43,937 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | perturb_xgb_depth_random : False 2021-08-20 00:48:43,942 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_autodl : True 2021-08-20 00:48:43,945 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_load_data_file : False 2021-08-20 00:48:43,949 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_period : 60 2021-08-20 00:48:43,953 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ping_sleep_period : 0.1 2021-08-20 00:48:43,956 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_options : [] 2021-08-20 00:48:43,959 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_overall_retries : 2 2021-08-20 00:48:43,962 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_retries : 5 2021-08-20 00:48:43,965 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_timeout : 15 2021-08-20 00:48:43,971 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_use_constraint : True 2021-08-20 00:48:43,974 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pip_install_verbosity : 2 2021-08-20 00:48:43,977 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | poisson_max_delta_step_list : [0.7, 0.9, 0.5, 0.2] 2021-08-20 00:48:43,982 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pred_labels : True 2021-08-20 00:48:43,986 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | predict_shuffle_inside_model : True 2021-08-20 00:48:43,989 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prediction_intervals : True 2021-08-20 00:48:43,993 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prediction_intervals_alpha : 0.9 2021-08-20 00:48:43,998 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_oom_reduced_features : True 2021-08-20 00:48:44,002 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_reduced_features_for_final_model : True 2021-08-20 00:48:44,006 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_varimp_reduced_features : False 2021-08-20 00:48:44,009 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | preserve_varimp_reduced_features_for_rescored : True 2021-08-20 00:48:44,013 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | print_recipe_code_once_accepted : True 2021-08-20 00:48:44,017 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_add_genes : 0.5 2021-08-20 00:48:44,023 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_addbest_genes : 0.5 2021-08-20 00:48:44,027 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_perturb_xgb : 0.25 2021-08-20 00:48:44,030 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_prune_by_features : 0.25 2021-08-20 00:48:44,033 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_prune_genes : 0.5 2021-08-20 00:48:44,037 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | prob_tune_model_vs_features : 0.5 2021-08-20 00:48:44,040 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | produce_correlation_heatmap : False 2021-08-20 00:48:44,043 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | python_client_path : 2021-08-20 00:48:44,049 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | python_client_url : https://s3.amazonaws.com/artifacts.h2o.ai/releases/ai/h2o/driverlessai/latest_release_whl.html 2021-08-20 00:48:44,052 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | python_client_verify_integrity : True 2021-08-20 00:48:44,057 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_bert_model_correct_bias : False 2021-08-20 00:48:44,069 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_bert_model_initial_lr : 2e-05 2021-08-20 00:48:44,072 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_fine_tuning_batch_size : -1 2021-08-20 00:48:44,075 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_fine_tuning_num_epochs : -1 2021-08-20 00:48:44,078 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_fine_tuning_padding_length : -1 2021-08-20 00:48:44,081 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_pretrained_models : ['bert-base-uncased', 'distilbert-base-uncased'] 2021-08-20 00:48:44,084 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_nlp_pretrained_models_dir : 2021-08-20 00:48:44,088 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_precision : 16 2021-08-20 00:48:44,091 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | pytorch_tokenizer_parallel : True 2021-08-20 00:48:44,095 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | quantile_alpha : [0.9, 0.95, 0.99, 0.6] 2021-08-20 00:48:44,097 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rdelta_percent_score_penalty_per_feature_by_interpretability : {1: 0.0, 2: 0.1, 3: 1.0, 4: 2.0, 5: 5.0, 6: 10.0, 7: 20.0, 8: 30.0, 9: 50.0, 10: 100.0, 11: 100.0, 12: 100.0, 13: 100.0} 2021-08-20 00:48:44,101 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe : auto 2021-08-20 00:48:44,104 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_dict * : {} 2021-08-20 00:48:44,107 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_load_raise_on_any_error : True 2021-08-20 00:48:44,111 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_load_raise_on_first_error : False 2021-08-20 00:48:44,114 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_load_raise_on_first_error_but_keep_accepted_recipes : False 2021-08-20 00:48:44,118 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_supported_file_types * : ['py', 'pyc', 'zip'] 2021-08-20 00:48:44,121 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipe_test_import_after_load_package : False 2021-08-20 00:48:44,125 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | recipes_temporary_data_directory : recipe_tmp 2021-08-20 00:48:44,128 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_db * : 0 2021-08-20 00:48:44,132 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_ip * : 127.0.0.1 2021-08-20 00:48:44,135 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_port * : 6379 2021-08-20 00:48:44,138 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | redis_result_queue_polling_interval : 100 2021-08-20 00:48:44,143 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_by_fraction : 0.1 2021-08-20 00:48:44,147 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_count_max : 10 2021-08-20 00:48:44,149 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_mojo_size : False 2021-08-20 00:48:44,152 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reduce_repeats_when_failure : 1 2021-08-20 00:48:44,155 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | refit_same_best_individual : False 2021-08-20 00:48:44,157 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reg_lambda_glm_default : 0.0004 2021-08-20 00:48:44,160 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_dup_genes : True 2021-08-20 00:48:44,164 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_scored_0gain_genes_in_postprocessing_above_interpretability : 13 2021-08-20 00:48:44,167 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_scored_0gain_genes_in_postprocessing_above_interpretability_final_population : 2 2021-08-20 00:48:44,172 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | remove_scored_by_threshold_genes_in_postprocessing_above_interpretability_final_population : 7 2021-08-20 00:48:44,176 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | reproducibility_level : 1 2021-08-20 00:48:44,181 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | require_graphviz : True 2021-08-20 00:48:44,184 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | restart_refit_redo_origfs_shift_leak : [] 2021-08-20 00:48:44,187 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | roc_reduce_type : rows 2021-08-20 00:48:44,193 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | round_up_indivs_for_busy_gpus : True 2021-08-20 00:48:44,196 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rows_ref : 2000000 2021-08-20 00:48:44,202 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_accuracy_switch : 8 2021-08-20 00:48:44,206 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_interpretability_switch : 1 2021-08-20 00:48:44,209 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_max_num_rules : -1 2021-08-20 00:48:44,213 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_max_num_trees : 100 2021-08-20 00:48:44,220 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | rulefit_max_tree_depth : 6 2021-08-20 00:48:44,223 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | s3_connector_cert_location : 2021-08-20 00:48:44,227 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | s3_init_path : s3:// 2021-08-20 00:48:44,230 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | s3_skip_cert_verification : False 2021-08-20 00:48:44,233 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | sample_cols_to_group_by : False 2021-08-20 00:48:44,237 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | sanitize_natural_sort_limit : 1000 2021-08-20 00:48:44,240 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | save_validation_splits : False 2021-08-20 00:48:44,244 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | scale_mem_for_max_bin : 10737418240 2021-08-20 00:48:44,247 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | scorers_need_x : False 2021-08-20 00:48:44,251 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | seed : 1234 2021-08-20 00:48:44,257 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | server_recipe_url : 2021-08-20 00:48:44,260 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | set_method_sampling_row_limit : 5000000 2021-08-20 00:48:44,264 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_check_reduced_features : True 2021-08-20 00:48:44,267 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_check_text : False 2021-08-20 00:48:44,270 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_high_notification_level : 0.8 2021-08-20 00:48:44,273 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_key_features_varimp : 0.01 2021-08-20 00:48:44,276 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_max_bin : 256 2021-08-20 00:48:44,278 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_max_max_depth : 8 2021-08-20 00:48:44,282 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_min_max_depth : 4 2021-08-20 00:48:44,285 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | shift_trees : 100 2021-08-20 00:48:44,299 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_all_filesystems : False 2021-08-20 00:48:44,302 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_constant_model : False 2021-08-20 00:48:44,305 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_fold_stats : True 2021-08-20 00:48:44,315 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_full_pipeline_details : False 2021-08-20 00:48:44,318 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_inapplicable_models_preview : False 2021-08-20 00:48:44,322 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_inapplicable_transformers_preview : False 2021-08-20 00:48:44,325 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_warnings_preview : False 2021-08-20 00:48:44,329 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | show_warnings_preview_unused_map_features : True 2021-08-20 00:48:44,334 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | size_search_stack : 100 2021-08-20 00:48:44,338 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | size_sub_stack : 100 2021-08-20 00:48:44,342 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | skip_disabled_recipes : False 2021-08-20 00:48:44,346 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | skip_model_failures : True 2021-08-20 00:48:44,350 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | skip_transformer_failures : True 2021-08-20 00:48:44,354 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | snowflake_allow_stages : True 2021-08-20 00:48:44,358 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | snowflake_batch_size : 10000 2021-08-20 00:48:44,361 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_ca_file : 2021-08-20 00:48:44,365 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_client_crt_file : 2021-08-20 00:48:44,368 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_client_key_file : 2021-08-20 00:48:44,375 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_client_verify_mode : CERT_NONE 2021-08-20 00:48:44,377 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_crt_file : /etc/dai/cert.pem 2021-08-20 00:48:44,381 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_key_file : /etc/dai/private_key.pem 2021-08-20 00:48:44,385 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_sslv2 : True 2021-08-20 00:48:44,388 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_sslv3 : True 2021-08-20 00:48:44,391 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1 : True 2021-08-20 00:48:44,399 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1_1 : True 2021-08-20 00:48:44,402 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1_2 : False 2021-08-20 00:48:44,405 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ssl_no_tlsv1_3 : False 2021-08-20 00:48:44,409 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stabilize_features : True 2021-08-20 00:48:44,414 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stabilize_fs : True 2021-08-20 00:48:44,418 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stabilize_varimp : True 2021-08-20 00:48:44,421 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stall_disk_limit_gb : 1 2021-08-20 00:48:44,424 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stall_subprocess_submission_dai_fork_threshold_count : 0 2021-08-20 00:48:44,428 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stall_subprocess_submission_mem_threshold_pct : 2 2021-08-20 00:48:44,434 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_cpu_measure_interval : -1 2021-08-20 00:48:44,438 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_pool_cpu_percent_threshold_kill : 5.0 2021-08-20 00:48:44,442 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_pool_gpu_percent_threshold_kill : 5.0 2021-08-20 00:48:44,449 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_reference_high_threshold : 1000000 2021-08-20 00:48:44,453 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_kill_ref : 440.0 2021-08-20 00:48:44,456 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_min : 120.0 2021-08-20 00:48:44,459 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_nrows_ref : 1000000 2021-08-20 00:48:44,462 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_nrowscols_ref : 10000000 2021-08-20 00:48:44,466 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stalled_time_ref : 240.0 2021-08-20 00:48:44,469 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | start_dask_worker * : True 2021-08-20 00:48:44,488 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | statistical_threshold_data_size_large : 500000000 2021-08-20 00:48:44,492 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | statistical_threshold_data_size_small : 100000 2021-08-20 00:48:44,495 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stop_early_abs_std : 0.001 2021-08-20 00:48:44,498 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stop_early_rel_std : 0.1 2021-08-20 00:48:44,502 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | stratify_for_regression : True 2021-08-20 00:48:44,505 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | strict_gpu_non_overlap : False 2021-08-20 00:48:44,509 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_image_max_missing_fraction : 0.1 2021-08-20 00:48:44,512 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_image_min_valid_types_fraction : 0.8 2021-08-20 00:48:44,515 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_text_min_absolute_cardinality : 10000 2021-08-20 00:48:44,518 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_text_min_relative_cardinality : 0.1 2021-08-20 00:48:44,522 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | string_col_as_text_threshold : 0.3 2021-08-20 00:48:44,525 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | supported_file_types * : ['csv', 'tsv', 'txt', 'dat', 'tgz', 'gz', 'bz2', 'zip', 'xz', 'xls', 'xlsx', 'jay', 'feather', 'bin', 'arff', 'parquet', 'pkl', 'orc', 'avro'] 2021-08-20 00:48:44,528 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | supported_image_types : ['jpg', 'jpeg', 'png', 'bmp', 'ppm', 'tif', 'tiff', 'JPG', 'JPEG', 'PNG', 'BMP', 'PPM', 'TIF', 'TIFF'] 2021-08-20 00:48:44,532 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | switch_from_tree_to_lgbm_if_can : True 2021-08-20 00:48:44,535 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | target_transformer : auto 2021-08-20 00:48:44,538 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | te_bin_list : [25, 10, 100, 250] 2021-08-20 00:48:44,541 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_accuracy_switch : 5 2021-08-20 00:48:44,544 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_allow_cpu_only : False 2021-08-20 00:48:44,547 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_check_import : True 2021-08-20 00:48:44,551 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_cores : 0 2021-08-20 00:48:44,554 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_disable_memory_optimization : True 2021-08-20 00:48:44,557 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_augmentations : ['HorizontalFlip'] 2021-08-20 00:48:44,563 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_batch_size : -1 2021-08-20 00:48:44,566 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_fine_tune : False 2021-08-20 00:48:44,570 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_fine_tuning_num_epochs : 2 2021-08-20 00:48:44,573 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_pretrained_models : ['xception'] 2021-08-20 00:48:44,576 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_pretrained_models_dir : ./pretrained/image/ 2021-08-20 00:48:44,587 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_use_gpu : True 2021-08-20 00:48:44,591 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_image_vectorization_output_dimension : [100] 2021-08-20 00:48:44,593 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_interpretability_switch : 6 2021-08-20 00:48:44,596 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_max_epochs_nlp : 2 2021-08-20 00:48:44,601 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_nlp_have_gpus_in_production : False 2021-08-20 00:48:44,604 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_nlp_pretrained_embeddings_file_path : 2021-08-20 00:48:44,607 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_nlp_pretrained_embeddings_trainable : False 2021-08-20 00:48:44,609 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_num_classes_switch : 10 2021-08-20 00:48:44,612 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_num_classes_switch_but_keep_lightgbm : 15 2021-08-20 00:48:44,615 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_use_all_cores : True 2021-08-20 00:48:44,619 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tensorflow_use_all_cores_even_if_reproducible_true : False 2021-08-20 00:48:44,622 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | terminate_train_backend_tuning : True 2021-08-20 00:48:44,626 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | terminate_train_feature_evolution : True 2021-08-20 00:48:44,629 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | terminate_train_tuning : True 2021-08-20 00:48:44,632 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_as_categorical_cardinality_threshold : 1000 2021-08-20 00:48:44,635 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_dl_token_pad_max : 512 2021-08-20 00:48:44,638 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_dl_token_pad_percentile : 99 2021-08-20 00:48:44,642 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_fraction_for_text_dominated_problem : 0.3 2021-08-20 00:48:44,645 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_gene_dim_reduction_choices : [50] 2021-08-20 00:48:44,649 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_gene_max_ngram : [1, 2] 2021-08-20 00:48:44,652 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_transformer_fraction_for_text_dominated_problem : 0.3 2021-08-20 00:48:44,655 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | text_transformers_max_vocabulary_size : [1000, 5000] 2021-08-20 00:48:44,659 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | textlin_num_classes_switch : 5 2021-08-20 00:48:44,662 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tf_nan_impute_value : -5 2021-08-20 00:48:44,665 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | threshold_data_size_large_to_use_cpu_for_fs : 100000000 2021-08-20 00:48:44,669 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | threshold_scorer : AUTO 2021-08-20 00:48:44,672 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | time_abort : 2021-08-20 00:48:44,675 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | time_abort_format : %Y-%m-%d %H:%M:%S 2021-08-20 00:48:44,678 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | time_abort_timezone : UTC 2021-08-20 00:48:44,681 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | torch_check_import : True 2021-08-20 00:48:44,684 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_feature_style_accuracy_switch : 13 2021-08-20 00:48:44,686 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_fullstack_style_accuracy_switch : 13 2021-08-20 00:48:44,689 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_model_style_accuracy_switch : 6 2021-08-20 00:48:44,693 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_style : auto 2021-08-20 00:48:44,696 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_uniform_style_accuracy_switch : 6 2021-08-20 00:48:44,699 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_uniform_style_interpretability_switch : 8 2021-08-20 00:48:44,702 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tournament_use_feature_penalized_score : True 2021-08-20 00:48:44,705 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | trace_lines_transformers : False 2021-08-20 00:48:44,712 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | training_report_period : 10 2021-08-20 00:48:44,715 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | transformer_description_line_length : -1 2021-08-20 00:48:44,718 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | transformer_precision : float32 2021-08-20 00:48:44,722 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tune_learning_rate : False 2021-08-20 00:48:44,725 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tune_parameters_accuracy_switch : 3 2021-08-20 00:48:44,728 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tune_target_transform_accuracy_switch : 5 2021-08-20 00:48:44,731 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tuning_share_varimp : best 2021-08-20 00:48:44,734 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tuning_share_varimp_accuracy_switch : 5 2021-08-20 00:48:44,737 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | tweedie_variance_power_list : [1.5, 1.2, 1.9] 2021-08-20 00:48:44,740 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | ulimit_up_to_hard_limit : True 2021-08-20 00:48:44,750 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | uniquify_indiv : True 2021-08-20 00:48:44,758 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | unsupervised_clustering_max_clusters : 10 2021-08-20 00:48:44,761 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | unsupervised_clustering_min_clusters : 2 2021-08-20 00:48:44,764 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_187_prob_logic : True 2021-08-20 00:48:44,766 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_all_columns_klime_kmeans : False 2021-08-20 00:48:44,769 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dask_cluster : True 2021-08-20 00:48:44,772 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dask_for_1_gpu : False 2021-08-20 00:48:44,775 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool : False 2021-08-20 00:48:44,778 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_capture_schema : False 2021-08-20 00:48:44,781 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_check_indiv : False 2021-08-20 00:48:44,784 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_detect_types : False 2021-08-20 00:48:44,788 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_dl2 : False 2021-08-20 00:48:44,791 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_final_munging : False 2021-08-20 00:48:44,795 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_final_predict : False 2021-08-20 00:48:44,798 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_final_training : False 2021-08-20 00:48:44,802 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_fs : False 2021-08-20 00:48:44,805 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_lgbm_fit : False 2021-08-20 00:48:44,809 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_mojo : False 2021-08-20 00:48:44,812 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_munging : False 2021-08-20 00:48:44,815 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_mutate : False 2021-08-20 00:48:44,819 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_onetask : False 2021-08-20 00:48:44,822 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_predict : False 2021-08-20 00:48:44,825 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_score : False 2021-08-20 00:48:44,828 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_training : False 2021-08-20 00:48:44,831 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_dummy_pool_xgb_fit : False 2021-08-20 00:48:44,834 C: 28% D:996.4GB M:244.6GB NODE:LOCAL1 7646 INFO | use_feature_brain_new_experiments : False 2021-08-20 00:48:44,838 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_forkdatacontext : True 2021-08-20 00:48:44,845 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_global_isolation_pool : False 2021-08-20 00:48:44,848 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_native_cats_for_lgbm_fs : True 2021-08-20 00:48:44,850 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_rf_for_leakage_if_have_lgbm : True 2021-08-20 00:48:44,852 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_rf_for_shift_if_have_lgbm : True 2021-08-20 00:48:44,854 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | use_xgboost_xgbfi : False 2021-08-20 00:48:44,857 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | validate_meta_learner : True 2021-08-20 00:48:44,860 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | validate_meta_learner_extra : False 2021-08-20 00:48:44,863 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | varimp_fspermute_factor : 1.0 2021-08-20 00:48:44,869 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | varimp_threshold_at_interpretability_10 : 0.01 2021-08-20 00:48:44,873 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | varimp_threshold_shift_report : 0.3 2021-08-20 00:48:44,876 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | verify_ipc_requests : True 2021-08-20 00:48:44,879 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | verify_session_ip : False 2021-08-20 00:48:44,883 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | version_old_custom : False 2021-08-20 00:48:44,886 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | version_old_custom_by_filename : False 2021-08-20 00:48:44,889 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | vis_server_ip : 127.0.0.1 2021-08-20 00:48:44,892 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | vis_server_port * : 12346 2021-08-20 00:48:44,897 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | warning_unused_feature_show_max : 3 2021-08-20 00:48:44,901 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | which_iteration_brain : -1 2021-08-20 00:48:44,912 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | woe_bin_list : [25, 10, 100, 250] 2021-08-20 00:48:44,915 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_healthy_response_period : 300 2021-08-20 00:48:44,918 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_local_processors : 32 2021-08-20 00:48:44,921 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_mode * : singlenode 2021-08-20 00:48:44,924 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_no_main_server_wait_time : 1800 2021-08-20 00:48:44,927 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_no_main_server_wait_time_with_hard_assert : 30 2021-08-20 00:48:44,931 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_priority_queues_processors : 4 2021-08-20 00:48:44,934 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_priority_queues_time_check : 30 2021-08-20 00:48:44,937 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_remote_processors * : 2 2021-08-20 00:48:44,942 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_remote_processors_max_threads_reduction_factor : 0.7 2021-08-20 00:48:44,946 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | worker_start_timeout : 30 2021-08-20 00:48:44,951 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | working_munging_max_transformers : 100 2021-08-20 00:48:44,956 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | working_munging_report_period : 120 2021-08-20 00:48:44,961 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | working_training_report_period : 60 2021-08-20 00:48:44,965 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | write_recipes_to_experiment_folder : True 2021-08-20 00:48:44,970 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | write_recipes_to_experiment_logger : False 2021-08-20 00:48:44,975 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgb_memory_pickled_estimate : False 2021-08-20 00:48:44,980 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_accuracy_switch : 1 2021-08-20 00:48:44,985 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_binary_metrics : ['logloss', 'auc', 'aucpr', 'error'] 2021-08-20 00:48:44,990 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_direct_datatable : False 2021-08-20 00:48:44,994 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_interpretability_switch : 10 2021-08-20 00:48:44,999 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_reduce_on_errors_list : ['Memory allocation error on worker', 'out of memory', 'XGBDefaultDeviceAllocatorImpl', 'invalid configuration argument', 'Requested memory'] 2021-08-20 00:48:45,003 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_reg_metrics : ['rmse', 'mae'] 2021-08-20 00:48:45,008 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_reg_objectives : ['reg:squarederror'] 2021-08-20 00:48:45,012 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | xgboost_rf_exact_threshold_num_rows_x_cols : 10000 2021-08-20 00:48:45,016 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:45,021 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,024 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Environment Variables 2021-08-20 00:48:45,028 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:45,032 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_DEFAULT_ENV : base 2021-08-20 00:48:45,035 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_EXE : /opt/h2oai/dai/python/bin/conda 2021-08-20 00:48:45,038 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_PREFIX : /opt/h2oai/dai/python 2021-08-20 00:48:45,041 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_PROMPT_MODIFIER : (base) 2021-08-20 00:48:45,054 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_PYTHON_EXE : /opt/h2oai/dai/python/bin/python 2021-08-20 00:48:45,057 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CONDA_SHLVL : 1 2021-08-20 00:48:45,061 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CPL_ZIP_ENCODING : UTF-8 2021-08-20 00:48:45,065 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CUDA_DEVICE_ORDER : PCI_BUS_ID 2021-08-20 00:48:45,069 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CUDA_PATH : /opt/h2oai/dai/python 2021-08-20 00:48:45,073 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | CUDA_VERSION : 11.2.2 2021-08-20 00:48:45,076 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_ENV_QUIET : 1 2021-08-20 00:48:45,079 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_INSTANCE_ID : 32a599f3-7f7e-43c8-9590-b51cd5a77e4d 2021-08-20 00:48:45,083 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_WORKER : true 2021-08-20 00:48:45,086 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DAI_WORKER_IP : 192.168.254.2 2021-08-20 00:48:45,090 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_CONFIG_FILE : /etc/dai/config.toml 2021-08-20 00:48:45,093 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_CUDA_VERSION : cuda-11.2 2021-08-20 00:48:45,096 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_DATA_DIRECTORY : ./tmp 2021-08-20 00:48:45,099 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_IP : 127.0.0.1 2021-08-20 00:48:45,103 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_MLI_NTHREADS : 8 2021-08-20 00:48:45,106 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_PORT : 12348 2021-08-20 00:48:45,109 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_H2O_XMX : 64457m 2021-08-20 00:48:45,112 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_HOME : /opt/h2oai/dai 2021-08-20 00:48:45,115 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_INSTANCE_ID : a18969fe-fbed-48b2-9d39-ac7bd71fffbd 2021-08-20 00:48:45,118 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_JAVA_HOME : /opt/h2oai/dai/jre 2021-08-20 00:48:45,122 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_MLI_CLOUD_NAME : H2O-MLI-DAI-20500 2021-08-20 00:48:45,125 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_PROCSY_PORT : 12347 2021-08-20 00:48:45,128 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_REDIS_PORT : 6379 2021-08-20 00:48:45,138 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_VIS_SERVER_PORT : 12346 2021-08-20 00:48:45,142 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | DRIVERLESS_AI_VIS_SERVER_XMX : 5g 2021-08-20 00:48:45,145 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | GDAL_DATA : /opt/h2oai/dai/python/share/gdal 2021-08-20 00:48:45,148 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | GSETTINGS_SCHEMA_DIR : /opt/h2oai/dai/python/share/glib-2.0/schemas 2021-08-20 00:48:45,151 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | GSETTINGS_SCHEMA_DIR_CONDA_BACKUP : 2021-08-20 00:48:45,154 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | HOME : /opt/h2oai/dai/home 2021-08-20 00:48:45,157 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | HOSTNAME : a2791a61aa6b 2021-08-20 00:48:45,161 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_HOME : /opt/h2oai/dai/jre 2021-08-20 00:48:45,164 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_HOME_CONDA_BACKUP : 2021-08-20 00:48:45,166 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_LD_LIBRARY_PATH : /opt/h2oai/dai/python/jre/lib/amd64/server 2021-08-20 00:48:45,169 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | JAVA_LD_LIBRARY_PATH_BACKUP : 2021-08-20 00:48:45,173 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | KMP_DUPLICATE_LIB_OK : True 2021-08-20 00:48:45,176 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | KMP_INIT_AT_FORK : FALSE 2021-08-20 00:48:45,179 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LANG : en_US.utf8 2021-08-20 00:48:45,183 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LC_ALL : en_US.utf8 2021-08-20 00:48:45,186 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LD_LIBRARY_PATH : /opt/h2oai/dai/python/lib:/opt/h2oai/dai/python/lib:/opt/h2oai/dai/python/lib:/opt/h2oai/dai/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/lib64/:/usr/lib64/ 2021-08-20 00:48:45,190 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LIBC_FATAL_STDERR_ : 1 2021-08-20 00:48:45,192 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | LIBRARY_PATH : /usr/local/cuda/lib64/stubs 2021-08-20 00:48:45,194 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MAGIC : /opt/h2oai/dai/share/misc/magic 2021-08-20 00:48:45,198 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MINIO_ACCESS_KEY : GMCSE2K2T3RV6YEHJUYW 2021-08-20 00:48:45,201 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MINIO_ADDRESS : 0.0.0.0:9001 2021-08-20 00:48:45,204 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MINIO_DIR : /opt/h2oai/dai/minio-data/ 2021-08-20 00:48:45,212 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | MKL_NUM_THREADS : 3 2021-08-20 00:48:45,215 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NCCL_VERSION : 2.8.4 2021-08-20 00:48:45,221 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NUMEXPR_MAX_THREADS : 3 2021-08-20 00:48:45,225 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVARCH : x86_64 2021-08-20 00:48:45,228 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_DRIVER_CAPABILITIES : compute,utility 2021-08-20 00:48:45,232 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_REQUIRE_CUDA : cuda>=11.2 brand=tesla,driver>=418,driver<419 brand=tesla,driver>=440,driver<441 driver>=450 2021-08-20 00:48:45,236 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_TF32_OVERRIDE : 0 2021-08-20 00:48:45,239 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NVIDIA_VISIBLE_DEVICES : all 2021-08-20 00:48:45,242 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDA_CUDART_DEV_VERSION : 11.2.152-1 2021-08-20 00:48:45,246 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDA_CUDART_VERSION : 11.2.152-1 2021-08-20 00:48:45,249 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDA_LIB_VERSION : 11.2.2-1 2021-08-20 00:48:45,256 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDNN_PACKAGE : libcudnn8-devel-8.1.1.33-1.cuda11.2 2021-08-20 00:48:45,258 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_CUDNN_VERSION : 8.1.1.33-1 2021-08-20 00:48:45,261 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBCUBLAS_DEV_VERSION : 11.4.1.1043-1 2021-08-20 00:48:45,264 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBCUBLAS_VERSION : 11.4.1.1043-1 2021-08-20 00:48:45,267 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_DEV_PACKAGE : libnccl-devel-2.8.4-1+cuda11.2 2021-08-20 00:48:45,270 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_DEV_PACKAGE_NAME : libnccl-devel 2021-08-20 00:48:45,273 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_DEV_PACKAGE_VERSION : 2.8.4-1 2021-08-20 00:48:45,276 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_PACKAGE : libnccl-2.8.4-1+cuda11.2 2021-08-20 00:48:45,280 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_PACKAGE_NAME : libnccl 2021-08-20 00:48:45,283 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_PACKAGE_VERSION : 2.8.4-1 2021-08-20 00:48:45,287 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNCCL_VERSION : 2.8.4 2021-08-20 00:48:45,290 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNPP_DEV_VERSION : 11.3.2.152-1 2021-08-20 00:48:45,293 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_LIBNPP_VERSION : 11.3.2.152-1 2021-08-20 00:48:45,296 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_NVML_DEV_VERSION : 11.2.152-1 2021-08-20 00:48:45,299 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_NVPROF_VERSION : 11.2.152-1 2021-08-20 00:48:45,303 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | NV_NVTX_VERSION : 11.2.152-1 2021-08-20 00:48:45,308 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | OMP_NUM_THREADS : 3 2021-08-20 00:48:45,312 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | OPENBLAS_MAIN_FREE : 1 2021-08-20 00:48:45,317 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | OPENBLAS_NUM_THREADS : 3 2021-08-20 00:48:45,322 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PATH : /opt/h2oai/dai/nodejs/bin:/opt/h2oai/dai/python/bin:/opt/h2oai/dai/bin:/opt/h2oai/dai/jre/bin:/opt/h2oai/dai/cuda-11.2/bin//opt/h2oai/dai/python/bin:/opt/h2oai/dai/python/condabin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2021-08-20 00:48:45,324 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PROJ_LIB : /opt/h2oai/dai/python/share/proj 2021-08-20 00:48:45,327 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PROJ_NETWORK : ON 2021-08-20 00:48:45,330 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PWD : /opt/h2oai/dai 2021-08-20 00:48:45,333 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PYTHONPATH : /tmp/n/contrib/env/lib/python3.8/site-packages:/opt/h2oai/dai/tmp/n/contrib/pretransformers:/opt/h2oai/dai/tmp/n/contrib/transformers:/opt/h2oai/dai/tmp/n/contrib/models:/opt/h2oai/dai/tmp/n/contrib/scorers:/opt/h2oai/dai/tmp/n/contrib/data:/opt/h2oai/dai/tmp/n/contrib/explainer 2021-08-20 00:48:45,336 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | PYTHONUSERBASE : /opt/h2oai/dai/cuda-11.2 2021-08-20 00:48:45,344 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | REDIS_PASSWORD_FROM_DAI_CONFIG : dnyhr9EDagD0lp9S9Eezyz8FI0Sy8gChWiWn4m0U 2021-08-20 00:48:45,347 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | RUN_DAI_CREATE_PIDFILE : 1 2021-08-20 00:48:45,349 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | RUN_DAI_LOG_DIR : /log/20210818-230644 2021-08-20 00:48:45,352 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | RUN_DAI_PIDFILE_DIR : /log/20210818-230644 2021-08-20 00:48:45,356 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | SEGFAULT_SIGNALS : all 2021-08-20 00:48:45,359 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | SHLVL : 3 2021-08-20 00:48:45,362 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | SSL_CERT_DIR : /etc/pki/tls/certs 2021-08-20 00:48:45,365 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TEMP : ./tmp/TMPDIR 2021-08-20 00:48:45,375 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TF2_BEHAVIOR : 1 2021-08-20 00:48:45,378 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TF_ENABLE_AUTO_MIXED_PRECISION : 0 2021-08-20 00:48:45,381 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TINI_VERSION : v0.19.0 2021-08-20 00:48:45,384 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TMPDIR : /opt/h2oai/dai/tmp/n 2021-08-20 00:48:45,388 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | TMP_DIR : ./tmp/TMPDIR 2021-08-20 00:48:45,391 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | XDG_CACHE_HOME : ./tmp/./matplotlib_cachedir_0 2021-08-20 00:48:45,394 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | _ : /opt/h2oai/dai/python/bin/python 2021-08-20 00:48:45,397 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | _CE_CONDA : 2021-08-20 00:48:45,399 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | _CE_M : 2021-08-20 00:48:45,403 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | __DAI_MAIN__ : true 2021-08-20 00:48:45,406 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_dask_server_ip : 192.168.254.2 2021-08-20 00:48:45,409 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_enable_dask_cluster : 0 2021-08-20 00:48:45,412 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_h2o_recipes_name : None 2021-08-20 00:48:45,415 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_h2o_recipes_port : 50361 2021-08-20 00:48:45,418 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_ip : 127.0.0.1 2021-08-20 00:48:45,421 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_access_key_id : GMCSE2K2T3RV6YEHJUYW 2021-08-20 00:48:45,425 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_address : 127.0.0.1:9001 2021-08-20 00:48:45,428 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_bucket : h2oai 2021-08-20 00:48:45,434 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_minio_secret_access_key : JFxmXvE/W1AaqwgyPxAUFsJZRnDWUaeQciZJUe9H 2021-08-20 00:48:45,437 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_main_server_redis_password : dnyhr9EDagD0lp9S9Eezyz8FI0Sy8gChWiWn4m0U 2021-08-20 00:48:45,440 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_mli_cloud_name : H2O-MLI-DAI-20500 2021-08-20 00:48:45,444 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_port : 12345 2021-08-20 00:48:45,447 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_redis_db : 0 2021-08-20 00:48:45,449 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_redis_ip : 127.0.0.1 2021-08-20 00:48:45,452 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_redis_port : 6379 2021-08-20 00:48:45,455 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_start_dask_worker : True 2021-08-20 00:48:45,458 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_worker_mode : singlenode 2021-08-20 00:48:45,461 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | dai_worker_remote_processors : 2 2021-08-20 00:48:45,464 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | no_proxy : localhost,127.0.0.1 2021-08-20 00:48:45,468 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,472 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Current working directory: /opt/h2oai/dai 2021-08-20 00:48:45,475 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,479 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | cat /proc/sys/kernel/sem:[32000, 1024000000, 500, 32000] 2021-08-20 00:48:45,482 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,485 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Physical cores: 20 2021-08-20 00:48:45,495 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Physical (psutil) cores: 20 2021-08-20 00:48:45,498 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Total (mp) cores: 40 2021-08-20 00:48:45,501 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Total (psutil) cores: 40 2021-08-20 00:48:45,505 C: 28% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | Total (os) cores: 40 2021-08-20 00:48:45,902 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Threading system info: [{'filepath': '/opt/h2oai/dai/python/lib/libopenblasp-r0.3.17.so', 'prefix': 'libopenblas', 'user_api': 'blas', 'internal_api': 'openblas', 'version': '0.3.17', 'num_threads': 3, 'threading_layer': 'pthreads'}, {'filepath': '/opt/h2oai/dai/python/lib/libgomp.so.1.0.0', 'prefix': 'libgomp', 'user_api': 'openmp', 'internal_api': 'openmp', 'version': None, 'num_threads': 3}] 2021-08-20 00:48:45,910 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Set for no core dumps 2021-08-20 00:48:45,911 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ulimit -n of 1048576 2021-08-20 00:48:45,914 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ulimit -u of 16384 2021-08-20 00:48:45,917 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,921 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Resource limits: {('RLIM_INFINITY', -1): (-1, -1), ('RLIMIT_AS', 9): (-1, -1), ('RLIMIT_CORE', 4): (0, 0), ('RLIMIT_CPU', 0): (-1, -1), ('RLIMIT_DATA', 2): (-1, -1), ('RLIMIT_FSIZE', 1): (-1, -1), ('RLIMIT_LOCKS', 10): (-1, -1), ('RLIMIT_MEMLOCK', 8): (65536, 65536), ('RLIMIT_MSGQUEUE', 12): (819200, 819200), ('RLIMIT_NICE', 13): (0, 0), ('RLIMIT_NOFILE', 7): (1048576, 1048576), ('RLIMIT_NPROC', 6): (16384, 16384), ('RLIMIT_RSS', 5): (-1, -1), ('RLIMIT_RTPRIO', 14): (0, 0), ('RLIMIT_SIGPENDING', 11): (1031055, 1031055), ('RLIMIT_STACK', 3): (-1, -1)} 2021-08-20 00:48:45,924 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:45,998 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Architecture: x86_64 2021-08-20 00:48:46,002 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU op-mode(s): 32-bit, 64-bit 2021-08-20 00:48:46,005 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Byte Order: Little Endian 2021-08-20 00:48:46,008 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU(s): 40 2021-08-20 00:48:46,011 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | On-line CPU(s) list: 0-39 2021-08-20 00:48:46,014 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Thread(s) per core: 2 2021-08-20 00:48:46,017 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Core(s) per socket: 10 2021-08-20 00:48:46,020 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Socket(s): 2 2021-08-20 00:48:46,026 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | NUMA node(s): 2 2021-08-20 00:48:46,029 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Vendor ID: GenuineIntel 2021-08-20 00:48:46,032 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU family: 6 2021-08-20 00:48:46,035 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Model: 79 2021-08-20 00:48:46,038 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Model name: Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz 2021-08-20 00:48:46,041 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Stepping: 1 2021-08-20 00:48:46,044 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU MHz: 2366.890 2021-08-20 00:48:46,047 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU max MHz: 3100.0000 2021-08-20 00:48:46,051 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CPU min MHz: 1200.0000 2021-08-20 00:48:46,061 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | BogoMIPS: 4400.07 2021-08-20 00:48:46,066 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Virtualization: VT-x 2021-08-20 00:48:46,069 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L1d cache: 32K 2021-08-20 00:48:46,071 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L1i cache: 32K 2021-08-20 00:48:46,074 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L2 cache: 256K 2021-08-20 00:48:46,078 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | L3 cache: 25600K 2021-08-20 00:48:46,081 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | NUMA node0 CPU(s): 0-9,20-29 2021-08-20 00:48:46,088 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | NUMA node1 CPU(s): 10-19,30-39 2021-08-20 00:48:46,091 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb invpcid_single intel_pt ssbd ibrs ibpb stibp kaiser tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdseed adx smap xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts md_clear flush_l1d 2021-08-20 00:48:46,095 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:46,098 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,218 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | Fri Aug 20 00:48:46 2021 2021-08-20 00:48:46,222 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-----------------------------------------------------------------------------+ 2021-08-20 00:48:46,225 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | NVIDIA-SMI 460.73.01 Driver Version: 460.73.01 CUDA Version: 11.2 | 2021-08-20 00:48:46,228 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | |-------------------------------+----------------------+----------------------+ 2021-08-20 00:48:46,234 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | 2021-08-20 00:48:46,237 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | 2021-08-20 00:48:46,240 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | | | MIG M. | 2021-08-20 00:48:46,243 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | |===============================+======================+======================| 2021-08-20 00:48:46,246 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 TITAN X (Pascal) On | 00000000:02:00.0 Off | N/A | 2021-08-20 00:48:46,249 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 43% 65C P2 64W / 250W | 819MiB / 12195MiB | 0% Default | 2021-08-20 00:48:46,252 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | | | N/A | 2021-08-20 00:48:46,255 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-------------------------------+----------------------+----------------------+ 2021-08-20 00:48:46,258 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 TITAN X (Pascal) On | 00000000:81:00.0 Off | N/A | 2021-08-20 00:48:46,261 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 46% 71C P2 189W / 250W | 2544MiB / 12196MiB | 72% Default | 2021-08-20 00:48:46,264 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | | | N/A | 2021-08-20 00:48:46,267 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-------------------------------+----------------------+----------------------+ 2021-08-20 00:48:46,271 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:46,274 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-----------------------------------------------------------------------------+ 2021-08-20 00:48:46,277 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | Processes: | 2021-08-20 00:48:46,280 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | GPU GI CI PID Type Process name GPU Memory | 2021-08-20 00:48:46,283 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | ID ID Usage | 2021-08-20 00:48:46,286 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | |=============================================================================| 2021-08-20 00:48:46,288 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 2115 G /usr/lib/xorg/Xorg 137MiB | 2021-08-20 00:48:46,292 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 12601 C ...cp://192.168.254.3:45687] 135MiB | 2021-08-20 00:48:46,295 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36404 C ...ginfit_model_lightgbmdask 135MiB | 2021-08-20 00:48:46,298 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36455 C ...ginfit_model_lightgbmdask 135MiB | 2021-08-20 00:48:46,301 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36708 C ...r [tcp://127.0.0.1:38515] 135MiB | 2021-08-20 00:48:46,304 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 0 N/A N/A 36742 C ...r [tcp://127.0.0.1:43950] 135MiB | 2021-08-20 00:48:46,308 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 12603 C ...cp://192.168.254.3:38537] 135MiB | 2021-08-20 00:48:46,311 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 30662 C ...infit_model_TextBERTModel 2135MiB | 2021-08-20 00:48:46,314 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 36701 C ...r [tcp://127.0.0.1:37457] 135MiB | 2021-08-20 00:48:46,317 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | | 1 N/A N/A 36745 C ...r [tcp://127.0.0.1:42252] 135MiB | 2021-08-20 00:48:46,320 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | +-----------------------------------------------------------------------------+ 2021-08-20 00:48:46,323 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:46,326 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,329 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,661 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CUDA runtime version detected: 11020 . Need: >= 11020 2021-08-20 00:48:46,667 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CUDA driver version detected: 11020 . Need: >= 11020 2021-08-20 00:48:46,672 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | CuDNN version detected: 8100 . Need: >= 8100 2021-08-20 00:48:46,860 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:46,863 C: 23% D:996.4GB M:244.3GB NODE:LOCAL1 7646 INFO | System check: 2021-08-20 00:48:47,114 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - GPU(s): PASSED 2021-08-20 00:48:47,951 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - OpenCL: PASSED 2021-08-20 00:48:47,955 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - OpenBLAS: PASSED 2021-08-20 00:48:47,962 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Memory: PASSED 2021-08-20 00:48:47,965 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Disk: PASSED 2021-08-20 00:48:48,024 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Graphviz: PASSED 2021-08-20 00:48:48,027 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | - Conda: PASSED 2021-08-20 00:48:48,029 C: 27% D:996.4GB M:244.0GB NODE:LOCAL1 7646 INFO | ----------------------------------------------------------------- 2021-08-20 00:48:48,805 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Number of threads for parent process of experiment: OpenBLAS: 1 DataTable: 3 Total: 7 2021-08-20 00:48:48,811 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Ingesting training data... 2021-08-20 00:48:48,815 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 DATA | Reading None data from: ./tmp/n/61efab2a-ef06-11eb-aeb8-0242c0a8fe03/Friedman1-results.csv.1627409626.1267896.bin 2021-08-20 00:48:48,835 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Successfully imported datatable binary file. 2021-08-20 00:48:48,840 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Data shape: (1000, 11) 2021-08-20 00:48:48,843 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Data size: 0.09 MiB 2021-08-20 00:48:48,846 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Time to read the None dataset with datatable: 0.02821016 2021-08-20 00:48:49,264 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 DATA | Training data file name: Friedman1-results.csv 2021-08-20 00:48:49,266 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | H2O Driverless AI Version: 1.10.0 2021-08-20 00:48:49,269 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Selected Accuracy: 7 / 10 2021-08-20 00:48:49,271 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Selected Time: 2 / 10 2021-08-20 00:48:49,274 C: 41% D:996.4GB M:242.9GB NODE:LOCAL1 7646 INFO | Selected Interpretability: 8 / 10 2021-08-20 00:48:49,878 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Turning accuracy/time/interpretability into: 2021-08-20 00:48:49,885 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | individuals: 8 2021-08-20 00:48:49,886 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | iterations=10 2021-08-20 00:48:49,888 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | experiment early_stopping_rounds=5 2021-08-20 00:48:49,891 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | only_first_fold_model=False 2021-08-20 00:48:49,894 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | num_folds=3 2021-08-20 00:48:49,897 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | fold_reps=2 2021-08-20 00:48:49,900 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | monotonicity_constraints=True 2021-08-20 00:48:49,903 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | parameter_tuning_num_models=4 2021-08-20 00:48:49,907 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | auto_tune_target_transform=True 2021-08-20 00:48:49,910 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | auto_tune_backend=True 2021-08-20 00:48:49,913 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | ensemble_level=1 2021-08-20 00:48:49,916 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | num_ensemble_folds=3 2021-08-20 00:48:49,919 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | max_rows=1000 2021-08-20 00:48:49,922 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | max_rows_feature_evolution=1000 2021-08-20 00:48:49,925 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | strategy=FS 2021-08-20 00:48:49,928 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Genetic Algorithm Used=True 2021-08-20 00:48:49,933 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | cols_to_drop=[] 2021-08-20 00:48:50,174 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | show_local_args : function name "" 2021-08-20 00:48:50,176 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | : self = 2021-08-20 00:48:50,178 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Writing autoreport arguments to file: '/opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/args_do_auto_dl.json' 2021-08-20 00:48:50,184 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Time limit for feature evolution: 1440 minute(s) 2021-08-20 00:48:50,187 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Experiment will automatically advance to the final pipeline creation (by hitting the Finish button) after 1 day if not completed. 2021-08-20 00:48:50,190 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Experiment will automatically be aborted after 7 days if not completed. 2021-08-20 00:48:50,232 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | h2oaicore hashes: wheel=4d0fa399cc29d558c62ec11a55d326d1036c08e7 git= jen=None 2021-08-20 00:48:50,235 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using 20 threads. 2021-08-20 00:48:50,238 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using seed: 1037348886 that is random 2021-08-20 00:48:50,244 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Size of file system containing temp dir: 3.8TB 2021-08-20 00:48:50,247 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Available space on file system containing temp dir: 996.4GB 2021-08-20 00:48:50,250 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Temporary directory: ./tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02 2021-08-20 00:48:50,252 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using datatable version '1.1.0a2071', git revision 'a5cd41'. 2021-08-20 00:48:50,255 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Using datatable 'auto' strategy. 2021-08-20 00:48:50,355 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Validation data file name: [Valid] 2021-08-20 00:48:50,358 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Checking data integrity... 2021-08-20 00:48:50,365 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Preparing data... 2021-08-20 00:48:50,735 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.0 -> X_0 2021-08-20 00:48:50,736 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.1 -> X_1 2021-08-20 00:48:50,738 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.2 -> X_2 2021-08-20 00:48:50,740 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.3 -> X_3 2021-08-20 00:48:50,743 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.4 -> X_4 2021-08-20 00:48:50,745 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.5 -> X_5 2021-08-20 00:48:50,747 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.6 -> X_6 2021-08-20 00:48:50,749 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.7 -> X_7 2021-08-20 00:48:50,751 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.8 -> X_8 2021-08-20 00:48:50,752 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 DATA | Sanitized: X.9 -> X_9 2021-08-20 00:48:50,754 C: 68% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Making column types consistent 1/5. 2021-08-20 00:48:51,043 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking for columns with constant values. 2021-08-20 00:48:51,434 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | No columns with constant values found. 2021-08-20 00:48:51,437 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Training data (with target): (1000, 11) 2021-08-20 00:48:51,462 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | First 10 rows of training data (important columns first): 2021-08-20 00:48:51,464 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | y X_0 X_1 X_2 X_3 X_4 X_5 \ 2021-08-20 00:48:51,465 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 0 10.514909 0.538199 0.213243 0.545909 0.641347 0.101782 0.754774 2021-08-20 00:48:51,467 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 1 22.091112 0.511203 0.672601 0.090410 0.710904 0.640796 0.691265 2021-08-20 00:48:51,469 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2 23.637319 0.656581 0.584439 0.733004 0.905532 0.771787 0.303401 2021-08-20 00:48:51,470 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 3 14.704191 0.597656 0.470689 0.166544 0.398554 0.092230 0.408584 2021-08-20 00:48:51,472 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 4 10.539045 0.293327 0.914270 0.630422 0.285815 0.115279 0.336773 2021-08-20 00:48:51,474 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 5 22.610139 0.801309 0.564802 0.736706 0.706592 0.814840 0.873785 2021-08-20 00:48:51,475 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 6 7.257792 0.577830 0.021487 0.748883 0.089403 0.801798 0.840097 2021-08-20 00:48:51,477 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 7 17.263727 0.519056 0.505974 0.856837 0.218172 0.995577 0.259858 2021-08-20 00:48:51,479 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 8 12.772815 0.871417 0.314405 0.793712 0.273555 0.093837 0.688646 2021-08-20 00:48:51,480 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 9 11.847787 0.264395 0.159089 0.543836 0.519854 0.820067 0.573237 2021-08-20 00:48:51,482 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2021-08-20 00:48:51,484 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | X_6 X_7 X_8 X_9 2021-08-20 00:48:51,485 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 0 0.043807 0.583226 0.856884 0.378225 2021-08-20 00:48:51,487 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 1 0.815222 0.977165 0.838957 0.467587 2021-08-20 00:48:51,489 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2 0.981413 0.662462 0.048219 0.780521 2021-08-20 00:48:51,490 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 3 0.513700 0.351345 0.752186 0.751916 2021-08-20 00:48:51,492 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 4 0.938448 0.601610 0.186782 0.398579 2021-08-20 00:48:51,494 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 5 0.406951 0.618284 0.534756 0.798458 2021-08-20 00:48:51,495 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 6 0.367980 0.285126 0.427309 0.490019 2021-08-20 00:48:51,497 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 7 0.381162 0.792870 0.299612 0.496243 2021-08-20 00:48:51,499 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 8 0.698431 0.948396 0.739914 0.100188 2021-08-20 00:48:51,501 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 9 0.467852 0.177314 0.332409 0.532827 2021-08-20 00:48:51,502 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Using fold_reps=2 2021-08-20 00:48:51,504 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Stats for target column 'y': 2021-08-20 00:48:51,506 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | non-missing count: 1000 2021-08-20 00:48:51,507 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | mean: 14.3507 2021-08-20 00:48:51,509 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | std: 5.00501 2021-08-20 00:48:51,511 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | min: -1.26473 2021-08-20 00:48:51,513 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | max: 27.7104 2021-08-20 00:48:51,514 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | most frequent count: 1 2021-08-20 00:48:51,516 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | uniques: 1000 2021-08-20 00:48:51,518 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | -1.2647256273613907...1.6327903692454502: 5 rows 2021-08-20 00:48:51,519 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 1.6327903692454502...4.530306365852291: 16 rows 2021-08-20 00:48:51,521 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 4.530306365852291...7.427822362459131: 66 rows 2021-08-20 00:48:51,523 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 7.427822362459131...10.325338359065974: 135 rows 2021-08-20 00:48:51,524 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 10.325338359065974...13.222854355672816: 196 rows 2021-08-20 00:48:51,526 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 13.222854355672816...16.120370352279654: 207 rows 2021-08-20 00:48:51,528 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 16.120370352279654...19.017886348886496: 190 rows 2021-08-20 00:48:51,529 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 19.017886348886496...21.915402345493337: 116 rows 2021-08-20 00:48:51,531 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 21.915402345493337...24.81291834210018: 59 rows 2021-08-20 00:48:51,533 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 24.81291834210018...27.71043433870702: 10 rows 2021-08-20 00:48:51,534 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | 2021-08-20 00:48:51,536 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking target column... 2021-08-20 00:48:51,538 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking response again ... 2021-08-20 00:48:51,540 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking for redundant columns. 2021-08-20 00:48:51,542 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | No redundant columns found. 2021-08-20 00:48:51,543 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | GPU(s): enabled (up to 1 GPUs/model, starting gpu_id=0, 2 chosen GPUs for experiment out of 2 visible GPUs and 2 allowed visible GPUs). 2021-08-20 00:48:51,545 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Early stopping enabled. 2021-08-20 00:48:51,547 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Checking scorer... 2021-08-20 00:48:51,554 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Scorers 2021-08-20 00:48:51,562 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Scorer: RMSE (less is better) 2021-08-20 00:48:51,911 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Processing custom features... 2021-08-20 00:48:51,913 C: 62% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Detecting schema... 2021-08-20 00:48:54,081 C: 61% D:996.4GB M:242.8GB NODE:LOCAL1 7646 INFO | Detecting column types... 2021-08-20 00:48:55,538 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Time-series check disabled. 2021-08-20 00:48:55,547 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Original column types (will be processed more to get Final column types) 2021-08-20 00:48:55,549 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Date cols: [] 2021-08-20 00:48:55,550 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | DateTime cols: [] 2021-08-20 00:48:55,552 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | ID cols: [] 2021-08-20 00:48:55,554 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Categorical cols: [] 2021-08-20 00:48:55,556 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | OHE Categorical cols: [] 2021-08-20 00:48:55,558 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Numerical cols: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,560 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Text cols: [] 2021-08-20 00:48:55,562 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Image cols: [] 2021-08-20 00:48:55,565 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Time column: None 2021-08-20 00:48:55,567 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Fold column: None 2021-08-20 00:48:55,570 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Weight column: None 2021-08-20 00:48:55,573 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Target column: 'y' 2021-08-20 00:48:55,576 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Numerical as Categorical allowed 2021-08-20 00:48:55,579 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Final column types 2021-08-20 00:48:55,582 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type numeric: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,586 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type categorical: [] 2021-08-20 00:48:55,589 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type catlabel: [] 2021-08-20 00:48:55,591 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type ohe_categorical: [] 2021-08-20 00:48:55,595 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type datetime: [] 2021-08-20 00:48:55,598 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type date: [] 2021-08-20 00:48:55,600 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type text: [] 2021-08-20 00:48:55,603 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type raw: [] 2021-08-20 00:48:55,606 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type time_column: [] 2021-08-20 00:48:55,609 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type all: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,620 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type any: ['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'] 2021-08-20 00:48:55,626 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type id: [] 2021-08-20 00:48:55,630 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | col type image: [] 2021-08-20 00:48:56,374 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Models 2021-08-20 00:48:56,376 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for model restriction: Not included ==> dropping ['CONSTANT', 'DECISIONTREE', 'FTRL', 'GLM', 'IMAGEAUTO', 'LIGHTGBMDASK', 'RFCUML', 'RFCUMLDASK', 'RULEFIT', 'TENSORFLOW', 'TEXTALBERT', 'TEXTBERT', 'TEXTCAMEMBERT', 'TEXTDISTILBERT', 'TEXTMULTILINGUALBERT', 'TEXTROBERTA', 'TEXTXLM', 'TEXTXLMROBERTA', 'TEXTXLNET', 'XGBOOSTDART', 'XGBOOSTDARTDASK', 'XGBOOSTGBM', 'XGBOOSTGBMDASK', 'XGBOOSTRF', 'XGBOOSTRFDASK', 'ZEROINFLATEDLIGHTGBM', 'ZEROINFLATEDXGBOOST'] 2021-08-20 00:48:56,532 C: 61% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Scorers 2021-08-20 00:48:56,543 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:56,549 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Number of individuals: 8 2021-08-20 00:48:56,551 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated target transform tuning iterations: 2 2021-08-20 00:48:56,553 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated model and feature parameter tuning iterations: 4 2021-08-20 00:48:56,556 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated total (tuning + feature evolution) number of iterations: 16 2021-08-20 00:48:56,559 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated total (backend + tuning + feature evolution + final) number of models to train: 597 2021-08-20 00:48:56,561 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Backend tuning: 0 model(s) 2021-08-20 00:48:56,563 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Target transform tuning: 18 model(s) 2021-08-20 00:48:56,566 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Model and feature tuning: 48 model(s) 2021-08-20 00:48:56,568 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Feature pre-pruning: 0 model(s) 2021-08-20 00:48:56,571 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Feature evolution: 528 model(s) 2021-08-20 00:48:56,573 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Final pipeline: 3 model(s) 2021-08-20 00:48:56,576 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:56,616 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Summary of restricting of Transformers 2021-08-20 00:48:56,618 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No image columns ==> dropping ['ImageOriginalGene'] 2021-08-20 00:48:56,620 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No text columns ==> dropping ['TextLinRegressorGene'] 2021-08-20 00:48:56,622 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No time_column columns ==> dropping ['EwmaLagsGene'] 2021-08-20 00:48:56,624 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No date columns ==> dropping ['DateGene'] 2021-08-20 00:48:56,628 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No datetime columns ==> dropping ['DateTimeGene'] 2021-08-20 00:48:56,630 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No raw columns ==> dropping ['RawGene'] 2021-08-20 00:48:56,632 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Lexicographical label encoding or Isolation Forest Anomaly Score encoding disabled ==> dropping ['IsolationForestAnomalyAllColsGene', 'IsolationForestAnomalyAllNumColsGene', 'IsolationForestAnomalyGene', 'IsolationForestAnomalyNumCatGene', 'LexiLabelEncoderGene'] 2021-08-20 00:48:56,633 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Not applicable for regression ==> dropping ['CVTargetEncodeTransformer', 'CatTransformer', 'ClusterTETransformer', 'NumCatTETransformer', 'NumToCatTETransformer', 'NumToCatWoEMonotonicTransformer', 'NumToCatWoETransformer', 'OneHotEncodingTransformer', 'WeightOfEvidenceTransformer'] 2021-08-20 00:48:56,635 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Interpretability (8) out of range ==> dropping ['ClusterDistGene', 'ClusterIDTargetEncodeSingleGene', 'ClusterIdAllNumGene', 'NumToCatTargetEncodeSingleGene', 'StringConcatGene', 'TruncSvdAllNumGene', 'TruncSvdNumGene'] 2021-08-20 00:48:57,083 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 WARNING| - Feature engineering search space: [CVCatNumEncode, CVTargetEncode, Frequent, Interactions, NumCatTE, OneHotEncoding, Original] 2021-08-20 00:48:57,085 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 WARNING| - Feature engineering selected/enabled but inapplicable: [BERT, CVTECUML, CatOriginal, ClusterDistCUMLDask, ClusterDistCUML, ClusterDist, ClusterIdAllNum, ClusterTE, DBSCANCUMLDask, DBSCANCUML, DateOriginal, DateTimeDiff, DateTimeOriginal, Dates, EwmaLags, ImageOriginal, ImageVectorizer, IsHoliday, IsolationForestAnomalyAllNumeric, IsolationForestAnomalyNumCatAllCols, IsolationForestAnomalyNumCat, IsolationForestAnomalyNumeric, LagsAggregates, LagsInteraction, Lags, LexiLabelEncoder, MeanTarget, NumToCatTE, NumToCatWoEMonotonic, NumToCatWoE, Raw, StandardScaler, StringConcat, TSNECUML, TextBiGRU, TextCNN, TextCharCNN, TextLinModel, TextOriginal, Text, TruncSVDAllNum, TruncSVDCUMLDask, TruncSVDCUML, TruncSVDNum, UMAPCUMLDask, UMAPCUML, WeightOfEvidence] 2021-08-20 00:48:57,088 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | LightGBMModel has all input features handled by some transformer 2021-08-20 00:48:57,090 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | LightGBMModel *default* feature->transformer map 2021-08-20 00:48:57,093 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_0 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer', 'InteractionsTransformer'] 2021-08-20 00:48:57,095 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_1 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer', 'InteractionsTransformer'] 2021-08-20 00:48:57,097 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_2 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,100 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_3 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,102 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_4 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,104 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_5 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,107 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_6 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,109 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_7 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,112 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_8 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,115 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 DATA | X_9 :['OriginalTransformer', 'CVTargetEncodeTransformer', 'OneHotEncodingTransformer'] 2021-08-20 00:48:57,310 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,313 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Experiment: 59939c96-0150-11ec-a7e1-0242c0a8fe02 2021-08-20 00:48:57,315 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,317 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | ACCURACY [7/10]: 2021-08-20 00:48:57,319 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Training data size: *1,000 rows, 11 cols* 2021-08-20 00:48:57,321 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature evolution: *LightGBM*, *3-fold CV**, 2 reps* 2021-08-20 00:48:57,323 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Final pipeline: *LightGBM, averaged across 3-fold CV splits* 2021-08-20 00:48:57,325 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,327 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | TIME [2/10]: 2021-08-20 00:48:57,329 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature evolution: *8 individuals*, up to *10 iterations* 2021-08-20 00:48:57,331 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Early stopping: After *5* iterations of no improvement 2021-08-20 00:48:57,333 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,334 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | INTERPRETABILITY [8/10]: 2021-08-20 00:48:57,336 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature pre-pruning strategy: Permutation Importance FS 2021-08-20 00:48:57,341 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Monotonicity constraints: enabled 2021-08-20 00:48:57,343 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature engineering search space: [CVCatNumEncode, CVTargetEncode, Frequent, Interactions, NumCatTE, OneHotEncoding, Original] 2021-08-20 00:48:57,345 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,347 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | LightGBM models to train: 2021-08-20 00:48:57,350 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Target transform tuning: *18* 2021-08-20 00:48:57,352 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Model and feature tuning: *48* 2021-08-20 00:48:57,354 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Feature evolution: *528* 2021-08-20 00:48:57,356 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | - Final pipeline: *3* 2021-08-20 00:48:57,360 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,362 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Estimated runtime: *minutes* 2021-08-20 00:48:57,363 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Auto-click Finish/Abort if not done in: *1 day*/*7 days* 2021-08-20 00:48:57,367 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:48:57,369 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Preparing validation splits... 2021-08-20 00:48:57,378 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [Feature evolution (repeat 1)] Optimized fold splits: Target fold mean (target transformed) stddev: 0.01329 | means: [14.346849, 14.358292, 14.362315, 14.327351, 14.342845, 14.366349] 2021-08-20 00:48:57,398 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 0: KstestResult(statistic=0.02176727625829422, pvalue=0.9998424722802827) 2021-08-20 00:48:57,418 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 1: KstestResult(statistic=0.025154089621855738, pvalue=0.9981216923269776) 2021-08-20 00:48:57,437 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 2: KstestResult(statistic=0.02074638356497427, pvalue=0.9999414082418556) 2021-08-20 00:48:57,469 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [Feature evolution (repeat 2)] Optimized fold splits: Target fold mean (target transformed) stddev: 0.01793 | means: [14.3447695, 14.362441, 14.366518, 14.318932, 14.340719, 14.370607] 2021-08-20 00:48:57,484 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 0: KstestResult(statistic=0.024698351045656434, pvalue=0.9985813106473687) 2021-08-20 00:48:57,500 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 1: KstestResult(statistic=0.027531279405342373, pvalue=0.9937850958604381) 2021-08-20 00:48:57,516 C: 63% D:996.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 2: KstestResult(statistic=0.02358730544637591, pvalue=0.9993204937887651) 2021-08-20 00:48:57,555 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | [Final pipeline ] Optimized fold splits: Target fold mean (target transformed) stddev: 0.01329 | means: [14.346849, 14.358292, 14.362315, 14.327351, 14.342845, 14.366349] 2021-08-20 00:48:57,575 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 0: KstestResult(statistic=0.02176727625829422, pvalue=0.9998424722802827) 2021-08-20 00:48:57,592 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 1: KstestResult(statistic=0.025154089621855738, pvalue=0.9981216923269776) 2021-08-20 00:48:57,607 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Kolmogorov-Smirnov statistics for splits of fold 2: KstestResult(statistic=0.02074638356497427, pvalue=0.9999414082418556) 2021-08-20 00:48:57,610 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Not doing time-based splits. 2021-08-20 00:48:57,614 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Feature engineering training / validation splits: 2021-08-20 00:48:57,617 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #1: 666 / 334 - target min -1.264726 / 0.766517, target mean: 14.346850 / 14.358292, target max: 27.710434 / 26.761804, target std: 4.981032 / 5.059986 2021-08-20 00:48:58,203 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #2: 667 / 333 - target min -1.264726 / 2.914631, target mean: 14.362315 / 14.327350, target max: 26.761804 / 27.710434, target std: 4.999868 / 5.022746 2021-08-20 00:48:58,389 C: 64% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #3: 667 / 333 - target min 0.766517 / -1.264726, target mean: 14.342844 / 14.366349, target max: 27.710434 / 25.879954, target std: 5.037666 / 4.946448 2021-08-20 00:48:58,599 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #4: 666 / 334 - target min -1.264726 / 1.490552, target mean: 14.344769 / 14.362441, target max: 27.710434 / 25.997716, target std: 5.026847 / 4.968671 2021-08-20 00:48:58,803 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #5: 667 / 333 - target min -1.264726 / 1.101135, target mean: 14.366518 / 14.318931, target max: 26.492384 / 27.710434, target std: 4.981698 / 5.058766 2021-08-20 00:48:58,992 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #6: 667 / 333 - target min 1.101135 / -1.264726, target mean: 14.340719 / 14.370606, target max: 27.710434 / 26.492384, target std: 5.010135 / 5.002203 2021-08-20 00:48:59,183 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Doing backend tuning on data of shape (666, 11) / (334, 11) 2021-08-20 00:48:59,186 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Maximum number of rows (train or valid) for feature evolution: 667 2021-08-20 00:48:59,189 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Final ensemble training / validation splits: 2021-08-20 00:48:59,193 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #1: 666 / 334 - target min -1.264726 / 0.766517, target mean: 14.346850 / 14.358292, target max: 27.710434 / 26.761804, target std: 4.981032 / 5.059986 2021-08-20 00:48:59,382 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #2: 667 / 333 - target min -1.264726 / 2.914631, target mean: 14.362315 / 14.327350, target max: 26.761804 / 27.710434, target std: 4.999868 / 5.022746 2021-08-20 00:48:59,574 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | split #3: 667 / 333 - target min 0.766517 / -1.264726, target mean: 14.342844 / 14.366349, target max: 27.710434 / 25.879954, target std: 5.037666 / 4.946448 2021-08-20 00:48:59,939 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Maximum number of rows (train or valid) for final model/ensemble: 667 2021-08-20 00:48:59,966 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Summary of restricting of Transformers 2021-08-20 00:48:59,968 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No image columns ==> dropping ['ImageOriginalGene'] 2021-08-20 00:48:59,970 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No text columns ==> dropping ['TextLinRegressorGene'] 2021-08-20 00:48:59,972 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No time_column columns ==> dropping ['EwmaLagsGene'] 2021-08-20 00:48:59,974 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No catlabel columns ==> dropping ['CatMultiGene'] 2021-08-20 00:48:59,976 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No categorical columns ==> dropping ['FrequentGene'] 2021-08-20 00:48:59,977 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No numcat columns ==> dropping ['NumCatTargetEncodeMultiGene'] 2021-08-20 00:48:59,979 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No date columns ==> dropping ['DateGene'] 2021-08-20 00:48:59,981 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No ohe_categorical columns ==> dropping ['OneHotEncodingMultiGene'] 2021-08-20 00:48:59,983 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No datetime columns ==> dropping ['DateTimeGene'] 2021-08-20 00:48:59,985 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: No raw columns ==> dropping ['RawGene'] 2021-08-20 00:48:59,987 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Lexicographical label encoding or Isolation Forest Anomaly Score encoding disabled ==> dropping ['IsolationForestAnomalyAllNumColsGene', 'IsolationForestAnomalyGene'] 2021-08-20 00:48:59,989 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Not applicable for regression ==> dropping ['ClusterTETransformer', 'NumToCatTETransformer', 'NumToCatWoEMonotonicTransformer', 'NumToCatWoETransformer'] 2021-08-20 00:48:59,990 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Reason for transformer restriction: Interpretability (8) out of range ==> dropping ['ClusterDistGene', 'ClusterIDTargetEncodeSingleGene', 'ClusterIdAllNumGene', 'NumToCatTargetEncodeSingleGene', 'TruncSvdAllNumGene', 'TruncSvdNumGene'] 2021-08-20 00:48:59,992 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Transformers used (accuracy=7, time=2, interpretability=8, num_classes=1): ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 00:48:59,994 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Genes used (accuracy=7, time=2, interpretability=8, num_classes=1): ['InteractionsGene', 'OriginalGene'] 2021-08-20 00:49:00,202 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Tournament style: model 2021-08-20 00:49:00,204 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Selecting modeling backend... 2021-08-20 00:49:00,207 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Auto-tuning modeling backend: start. 2021-08-20 00:49:00,479 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Backend candidate Job# 0 Name: LightGBMModel using GPU (if applicable) with Booster: lightgbm 2021-08-20 00:49:00,485 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Backend candidate Job# 1 Name: LightGBMModel using CPU with Booster: lightgbm 2021-08-20 00:49:00,768 C: 60% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 1 total models across folds, out of population with 1 individuals). 2021-08-20 00:49:01,020 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | Completed 2 munging tasks out of 2 total tasks (including identity) for 1 indivs and 1 folds 2021-08-20 00:49:01,032 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348886', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 1) 2021-08-20 00:49:01,035 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 00:49:01,268 C: 63% D:996.4GB M:242.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) start. 2021-08-20 00:49:45,416 C: 67% D:995.6GB M:240.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 735.7MB, since last ping: 10.6MB/s. CPU memory usage: 484.2MB, max: 485.3MB CPU: 0% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.4kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 58% Nice: 0% System: 8% Wait: 0% DAIActiveprocs: 3 DAIprocs: 55) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train 1 (1) (True) [1000000, 1000000, 1000000] [0.0, 0.0, 0.0]] 2021-08-20 00:50:49,978 C: 65% D:996.4GB M:239.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 1.3GB, since last ping: 11.4kB/s. CPU memory usage: 486.0MB, max: 487.1MB CPU: 10% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.5kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 61% Nice: 0% System: 8% Wait: 0% DAIActiveprocs: 3 DAIprocs: 53) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train-training_xgb_indiv_0_fold_0] 2021-08-20 00:51:54,921 C: 67% D:995.7GB M:239.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 2.4GB, since last ping: 12.0MB/s. CPU memory usage: 483.7MB, max: 487.4MB CPU: 20% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.5kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 57% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 2 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train-training_xgb_indiv_0_fold_0] 2021-08-20 00:53:00,375 C: 65% D:996.4GB M:237.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 2.5GB, since last ping: 14.4kB/s. CPU memory usage: 487.2MB, max: 487.4MB CPU: 0% Procs: 4 . GPU memory usage: 0B, max: 34.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.6kB/s Size: 771.2kB) (Connections: 46 Fds: 195 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 58% Nice: 0% System: 7% Wait: 0% DAIActiveprocs: 1 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Selecting_modeling_backend...backend_tuning_train-training_xgb_indiv_0_fold_0] 2021-08-20 00:53:51,859 C: 70% D:995.8GB M:242.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1} 2021-08-20 00:53:51,867 C: 70% D:995.8GB M:242.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809'} 2021-08-20 00:53:51,869 C: 70% D:995.8GB M:242.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:53:58,161 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 1) end. Took 296.89186 seconds. 2021-08-20 00:53:58,174 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) start. 2021-08-20 00:53:58,176 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) start. 2021-08-20 00:53:58,249 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 2 iterations: 2 2021-08-20 00:53:58,253 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 1) model predict (334, 1) end. Took 0.07701 seconds. 2021-08-20 00:53:58,256 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 2) end. Took 0.08247 seconds. 2021-08-20 00:53:58,423 C: 50% D:995.9GB M:242.0GB NODE:LOCAL1 7646 INFO | Completed 1 training tasks out of 1 total tasks for 1 indivs and 1 folds 2021-08-20 00:53:59,296 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 2, model transformed features: 1, total model time: 297.2, fit model time: 297.19 2021-08-20 00:54:00,096 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Auto-tuning found optimal settings: LightGBMModel using GPU (if applicable) 2021-08-20 00:54:00,098 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'pred_gap': None, 'pred_periods': None, 'ufapt': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.8, 'subsample': 0.7, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None} 2021-08-20 00:54:00,101 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Auto-tuning modeling backend: end : Duration: 299.8936 s 2021-08-20 00:54:00,111 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:00,113 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Model(s) explored: ['LightGBMModel']. 2021-08-20 00:54:00,115 C: 31% D:995.7GB M:242.2GB NODE:LOCAL1 7646 INFO | Model(s) not explored due to restrictions: ['ConstantModel', 'DecisionTreeModel', 'FTRLModel', 'GLMModel', 'ImageAutoModel', 'ImbalancedLightGBMModel', 'ImbalancedTensorFlowModel', 'ImbalancedXGBoostGBMModel', 'IsolationForestAnomalyModel', 'LightGBMDaskModel', 'NumClusteringModel', 'NumFreqClusteringModel', 'NumOHEClusteringModel', 'RFCUMLDaskModel', 'RFCUMLModel', 'RuleFitModel', 'TensorFlowModel', 'TextALBERTModel', 'TextBERTModel', 'TextCamemBERTModel', 'TextDistilBERTModel', 'TextMultilingualBERTModel', 'TextRoBERTaModel', 'TextXLMModel', 'TextXLMRobertaModel', 'TextXLNETModel', 'TruncSVDModel', 'UnsupervisedModel', 'XGBoostDartDaskModel', 'XGBoostDartModel', 'XGBoostGBMDaskModel', 'XGBoostGBMModel', 'XGBoostModel', 'XGBoostRFDaskModel', 'XGBoostRFModel', 'ZeroInflatedLightGBMModel', 'ZeroInflatedXGBoostModel']. 2021-08-20 00:54:00,329 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:00,338 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Number of individuals: 8 2021-08-20 00:54:00,340 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated target transform tuning iterations: 2 2021-08-20 00:54:00,342 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated model and feature parameter tuning iterations: 4 2021-08-20 00:54:00,344 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated total (tuning + feature evolution) number of iterations: 16 2021-08-20 00:54:00,346 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Estimated total (backend + tuning + feature evolution + final) number of models to train: 598 2021-08-20 00:54:00,348 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Backend tuning: 1 model(s) 2021-08-20 00:54:00,350 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Target transform tuning: 18 model(s) 2021-08-20 00:54:00,352 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Model and feature tuning: 48 model(s) 2021-08-20 00:54:00,354 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Feature pre-pruning: 0 model(s) 2021-08-20 00:54:00,368 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Feature evolution: 528 model(s) 2021-08-20 00:54:00,371 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Final pipeline: 3 model(s) 2021-08-20 00:54:00,374 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:00,381 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Checking for leakage... 2021-08-20 00:54:00,384 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | Checking for leakage in training ... 2021-08-20 00:54:00,433 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 DATA | leakage model params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'rf', 'enable_early_stopping_rounds': True, 'grow_policy': 'depthwise', 'max_depth': 8, 'max_leaves': 256, 'max_bin': 256, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.33, 'subsample': 0.632, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': False, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': None, 'n_estimators': 100, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None} 2021-08-20 00:54:00,569 C: 22% D:996.4GB M:241.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (750, 10) start. 2021-08-20 00:54:04,478 C: 28% D:996.4GB M:240.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.0GB, since last ping: 21.2kB/s. CPU memory usage: 482.9MB, max: 752.3MB CPU: 0% Procs: 4 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 251.7kB/s Size: 797.0kB) (Connections: 46 Fds: 196 WinHandles: 0 Threads: 10 Maps: 3179 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 9% Wait: 1% DAIActiveprocs: 3 DAIprocs: 54) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Checking_for_leakage...] 2021-08-20 00:54:30,422 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (750, 10) end. Took 29.85287 seconds. 2021-08-20 00:54:30,596 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (250, 10) start. 2021-08-20 00:54:30,599 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (250, 10) model predict (250, 10) start. 2021-08-20 00:54:30,728 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 00:54:30,732 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (250, 10) model predict (250, 10) end. Took 0.13402 seconds. 2021-08-20 00:54:30,735 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (250, 10) end. Took 0.14125 seconds. 2021-08-20 00:54:31,124 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Time for leakage check for training and None: 30.6861 [secs] 2021-08-20 00:54:31,128 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | No significant leakage detected in training data ( R2: 0.7957284 ) 2021-08-20 00:54:31,537 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 00:54:31,543 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 00:54:31,545 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| Number of tree iterations for tuning and feature evolution models (300) is smaller than iterations for final models (500). 2021-08-20 00:54:31,547 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| If unexpected, change max_nestimators_feature_evolution_factor=0.2 to 1.0 in expert settings. 2021-08-20 00:54:31,550 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| Scores shown during tuning and feature evolution may underestimate performance of final pipeline. 2021-08-20 00:54:31,551 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| Please wait for final scores. 2021-08-20 00:54:31,553 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 WARNING| 2021-08-20 00:54:31,555 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Regression target transformer tuning... 2021-08-20 00:54:31,886 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | target transform tuning iterations: 2 2021-08-20 00:54:31,889 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Tuned 0/18 target transform tuning models. Tuning [LIGHTGBM] 2021-08-20 00:54:31,893 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | 2021-08-20 00:54:31,895 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 00:54:31,898 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | Starting Iteration: 0 2021-08-20 00:54:31,903 C: 43% D:996.4GB M:242.1GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 00:54:32,630 C: 71% D:996.4GB M:240.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 00:54:34,590 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 00:54:34,603 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 00:54:34,607 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 00:54:34,610 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348886', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 00:54:34,613 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 00:54:34,836 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:54:34,957 C: 71% D:995.7GB M:240.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:55:09,587 C: 57% D:995.7GB M:239.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.2GB, since last ping: 20.2kB/s. CPU memory usage: 546.5MB, max: 771.0MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 1.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 38% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 1 DAIprocs: 55) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_0_fold_2] 2021-08-20 00:56:15,348 C: 26% D:996.4GB M:241.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.5GB, since last ping: 20.2kB/s. CPU memory usage: 547.4MB, max: 771.0MB CPU: 30% Procs: 5 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 4.5kB/s Size: 1.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 3 DAIprocs: 55) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_0_fold_2] 2021-08-20 00:56:22,956 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:56:22,964 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 00:56:22,965 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:56:23,818 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 108.86090 seconds. 2021-08-20 00:56:23,832 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:56:23,834 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:56:23,904 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 00:56:23,910 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07525 seconds. 2021-08-20 00:56:23,914 C: 26% D:996.4GB M:241.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08041 seconds. 2021-08-20 00:56:24,193 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 2 3 and Completed 1 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 00:56:24,203 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 00:56:24,206 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Time: 109.498 s: LIGHTGBM Parameters: OrderedDict([('num_classes', 1), ('num_class', 1), ('booster', 'lightgbm'), ('seed', 1037348886), ('disable_gpus', False), ('n_gpus', 1), ('score_f_name', 'RMSE'), ('labels', None), ('label_counts', None), ('_build_info', {'commit': '4d0fa39', 'version': '1.10.0'}), ('model_class_name', 'LightGBMModel'), ('gpu_id', 0), ('n_jobs', 4), ('random_state', 1037348886), ('time_column', None), ('encoder', None), ('tgc', None), ('pred_gap', None), ('pred_periods', None), ('target', None), ('ufapt', None), ('tsp', None), ('boosting_type', 'gbdt'), ('enable_early_stopping_rounds', True), ('learning_rate', 0.05), ('grow_policy', 'depthwise'), ('max_depth', 10), ('max_leaves', 1024), ('max_bin', 64), ('scale_pos_weight', 1.0), ('max_delta_step', 0.0), ('gamma', 0.0), ('colsample_bytree', 0.8), ('subsample', 0.7), ('subsample_freq', 1), ('reg_lambda', 0.0), ('reg_alpha', 0.0), ('min_child_samples', 1), ('min_data_in_bin', 1), ('min_child_weight', 0.001), ('min_split_gain', 0.0), ('subsample_for_bin', 200000), ('class_weight', None), ('monotonicity_constraints', True), ('objective', 'mse'), ('eval_metric', 'rmse'), ('early_stopping_rounds', 30), ('n_estimators', 300), ('importance_type', 'gain'), ('num_leaves', 1024), ('feature_fraction_seed', 1037348887), ('bagging_seed', 1037348888), ('num_threads', 4), ('device_type', 'gpu'), ('gpu_device_id', 0), ('gpu_platform_id', 0), ('gpu_use_dp', False), ('verbose', -1), ('lossguide', False), ('silent', True), ('accuracy', 7), ('time_tolerance', 2), ('interpretability', 8), ('ensemble_level', 1), ('train_shape', (1000, 11)), ('valid_shape', None), ('model_origin', 'TARGET_TUNING'), ('optuna_trial', None), ('optuna_trial_state', None)]) 2021-08-20 00:56:24,209 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 00:56:24,211 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | Time: 109.498 s: LIGHTGBM 2021-08-20 00:56:24,295 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:56:24,298 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 00:56:24,300 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:56:24,326 C: 23% D:996.4GB M:241.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:56:25,477 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 110.64158 seconds. 2021-08-20 00:56:25,489 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:56:25,491 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:56:25,558 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 00:56:25,564 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07250 seconds. 2021-08-20 00:56:25,567 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07783 seconds. 2021-08-20 00:56:25,898 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:56:25,903 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:56:25,905 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 00:56:25,908 C: 35% D:996.4GB M:240.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:56:27,637 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 3.30620 seconds. 2021-08-20 00:56:27,650 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:56:27,652 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:56:27,719 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 00:56:27,726 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07275 seconds. 2021-08-20 00:56:27,728 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07852 seconds. 2021-08-20 00:56:28,060 C: 34% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:57:21,455 C: 24% D:996.4GB M:236.7GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.7GB, since last ping: 6.4kB/s. CPU memory usage: 545.3MB, max: 771.0MB CPU: 69% Procs: 5 . GPU memory usage: 0B, max: 141.6MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.8kB/s Size: 1.0MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4005 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 10% Wait: 0% DAIActiveprocs: 3 DAIprocs: 54) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_0_fold_5] 2021-08-20 00:58:16,683 C: 25% D:996.4GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:16,689 C: 25% D:996.4GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 00:58:16,691 C: 25% D:996.4GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:22,610 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 116.70691 seconds. 2021-08-20 00:58:22,624 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:58:22,627 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:58:22,702 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 00:58:22,708 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08075 seconds. 2021-08-20 00:58:22,711 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08654 seconds. 2021-08-20 00:58:22,949 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 5 6 and Completed 4 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 00:58:22,953 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 00:58:22,958 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 DATA | Time: 115.017 s: LIGHTGBM Parameters: OrderedDict([('num_classes', 1), ('num_class', 1), ('booster', 'lightgbm'), ('seed', 1037348886), ('disable_gpus', False), ('n_gpus', 1), ('score_f_name', 'RMSE'), ('labels', None), ('label_counts', None), ('_build_info', {'commit': '4d0fa39', 'version': '1.10.0'}), ('model_class_name', 'LightGBMModel'), ('gpu_id', 0), ('n_jobs', 4), ('random_state', 1037348886), ('time_column', None), ('encoder', None), ('tgc', None), ('pred_gap', None), ('pred_periods', None), ('target', None), ('ufapt', None), ('tsp', None), ('boosting_type', 'gbdt'), ('enable_early_stopping_rounds', True), ('learning_rate', 0.05), ('grow_policy', 'depthwise'), ('max_depth', 10), ('max_leaves', 1024), ('max_bin', 64), ('scale_pos_weight', 1.0), ('max_delta_step', 0.0), ('gamma', 0.0), ('colsample_bytree', 0.8), ('subsample', 0.7), ('subsample_freq', 1), ('reg_lambda', 0.0), ('reg_alpha', 0.0), ('min_child_samples', 1), ('min_data_in_bin', 1), ('min_child_weight', 0.001), ('min_split_gain', 0.0), ('subsample_for_bin', 200000), ('class_weight', None), ('monotonicity_constraints', True), ('objective', 'mse'), ('eval_metric', 'rmse'), ('early_stopping_rounds', 30), ('n_estimators', 300), ('importance_type', 'gain'), ('num_leaves', 1024), ('feature_fraction_seed', 1037348887), ('bagging_seed', 1037348888), ('num_threads', 4), ('device_type', 'gpu'), ('gpu_device_id', 0), ('gpu_platform_id', 0), ('gpu_use_dp', False), ('verbose', -1), ('lossguide', False), ('silent', True), ('accuracy', 7), ('time_tolerance', 2), ('interpretability', 8), ('ensemble_level', 1), ('train_shape', (1000, 11)), ('valid_shape', None), ('model_origin', 'TARGET_TUNING'), ('optuna_trial', None), ('optuna_trial_state', None)]) 2021-08-20 00:58:22,962 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 00:58:22,965 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | Time: 115.017 s: LIGHTGBM 2021-08-20 00:58:23,067 C: 31% D:996.4GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:25,112 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 00:58:25,121 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 00:58:25,122 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:25,925 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 3.8GB, since last ping: 1.4MB/s. CPU memory usage: 717.2MB, max: 771.0MB CPU: 89% Procs: 5 . GPU memory usage: 149.9MB, max: 149.9MB GPUs usage: 4% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 10.5kB/s Size: 1.0MB) (Connections: 58 Fds: 281 WinHandles: 0 Threads: 13 Maps: 4000 WinOpenFiles: 0) (System-Wide CPU: User: 19% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 3 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_1_fold_0] 2021-08-20 00:58:25,976 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.90898 seconds. 2021-08-20 00:58:25,986 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:25,988 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:26,053 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 00:58:26,060 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07076 seconds. 2021-08-20 00:58:26,062 C: 27% D:996.4GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07619 seconds. 2021-08-20 00:58:26,327 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:26,333 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 00:58:26,335 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:26,382 C: 31% D:996.4GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:58:27,784 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 119.72338 seconds. 2021-08-20 00:58:27,795 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:27,798 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:27,868 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 00:58:27,874 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07600 seconds. 2021-08-20 00:58:27,876 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08086 seconds. 2021-08-20 00:58:28,112 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:28,115 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 00:58:28,117 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:28,185 C: 30% D:996.4GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:29,123 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 2.74028 seconds. 2021-08-20 00:58:29,135 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:58:29,138 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:58:29,213 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 00:58:29,226 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08636 seconds. 2021-08-20 00:58:29,230 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09345 seconds. 2021-08-20 00:58:29,559 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:29,599 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:29,601 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 00:58:29,603 C: 29% D:996.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:30,649 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.46447 seconds. 2021-08-20 00:58:30,659 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:30,661 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:30,722 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 00:58:30,727 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06588 seconds. 2021-08-20 00:58:30,730 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07047 seconds. 2021-08-20 00:58:31,070 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 00:58:31,109 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:31,112 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 00:58:31,114 C: 30% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:32,171 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.61031 seconds. 2021-08-20 00:58:32,184 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:32,187 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:32,252 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 00:58:32,258 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07171 seconds. 2021-08-20 00:58:32,261 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07719 seconds. 2021-08-20 00:58:32,507 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:32,509 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 00:58:32,512 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:32,609 C: 28% D:996.4GB M:238.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:33,387 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 2.31693 seconds. 2021-08-20 00:58:33,399 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 00:58:33,401 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 00:58:33,471 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 00:58:33,478 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07675 seconds. 2021-08-20 00:58:33,481 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08246 seconds. 2021-08-20 00:58:33,768 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 5 12 and Completed 10 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 00:58:33,852 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 00:58:33,855 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 00:58:33,858 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 00:58:33,908 C: 29% D:996.4GB M:238.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 00:58:34,718 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.10905 seconds. 2021-08-20 00:58:34,728 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 00:58:34,730 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 00:58:34,793 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 00:58:34,800 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06906 seconds. 2021-08-20 00:58:34,802 C: 29% D:996.4GB M:238.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07395 seconds. 2021-08-20 00:59:30,950 C: 24% D:996.3GB M:233.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 4.4GB, since last ping: 2.3MB/s. CPU memory usage: 508.3MB, max: 771.0MB CPU: 29% Procs: 4 . GPU memory usage: 0B, max: 149.9MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.6kB/s Size: 1.1MB) (Connections: 46 Fds: 209 WinHandles: 0 Threads: 10 Maps: 3189 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 3 DAIprocs: 51) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_1_fold_5] 2021-08-20 01:00:16,360 C: 22% D:996.4GB M:235.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:16,366 C: 22% D:996.4GB M:235.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:16,368 C: 22% D:996.4GB M:235.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:21,485 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 107.57663 seconds. 2021-08-20 01:00:21,496 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:21,498 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:21,563 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:00:21,569 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07060 seconds. 2021-08-20 01:00:21,571 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07534 seconds. 2021-08-20 01:00:21,753 C: 28% D:996.4GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:00:23,418 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 109.16, fit model time: 109.16 2021-08-20 01:00:23,424 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 110.92, fit model time: 110.92 2021-08-20 01:00:23,426 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 3.5899, fit model time: 3.5891 2021-08-20 01:00:23,427 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 116.99, fit model time: 116.99 2021-08-20 01:00:23,429 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 3.1707, fit model time: 3.1698 2021-08-20 01:00:23,431 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 119.99, fit model time: 119.99 2021-08-20 01:00:23,433 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 3.0246, fit model time: 3.0237 2021-08-20 01:00:23,435 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 2.7106, fit model time: 2.7098 2021-08-20 01:00:23,437 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 2.8901, fit model time: 2.8891 2021-08-20 01:00:23,439 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 2.5857, fit model time: 2.5848 2021-08-20 01:00:23,441 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 2.3871, fit model time: 2.3864 2021-08-20 01:00:23,443 C: 27% D:996.4GB M:240.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 107.86, fit model time: 107.86 2021-08-20 01:00:24,515 C: 23% D:996.4GB M:240.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:00:26,089 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:00:26,341 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:26,422 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:26,617 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:26,619 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:26,621 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:26,688 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:26,691 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:26,693 C: 21% D:996.4GB M:239.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:28,239 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.89590 seconds. 2021-08-20 01:00:28,252 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:28,255 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:28,340 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:00:28,348 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.09205 seconds. 2021-08-20 01:00:28,350 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.09840 seconds. 2021-08-20 01:00:28,435 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 2.01287 seconds. 2021-08-20 01:00:28,446 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:28,449 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:28,513 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:00:28,522 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07194 seconds. 2021-08-20 01:00:28,526 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07836 seconds. 2021-08-20 01:00:28,677 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:28,879 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:28,966 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:28,969 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:28,971 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:29,202 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:29,204 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:29,207 C: 38% D:996.4GB M:239.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:30,241 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.56225 seconds. 2021-08-20 01:00:30,265 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:30,269 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:30,353 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:00:30,361 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.09301 seconds. 2021-08-20 01:00:30,364 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.10006 seconds. 2021-08-20 01:00:30,448 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.56954 seconds. 2021-08-20 01:00:30,459 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:30,461 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:30,529 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:00:30,535 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07366 seconds. 2021-08-20 01:00:30,538 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07890 seconds. 2021-08-20 01:00:30,714 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:30,944 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:30,968 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:30,970 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:30,972 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:31,214 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:31,217 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:31,219 C: 45% D:996.3GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:32,121 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.40640 seconds. 2021-08-20 01:00:32,135 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:32,139 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:32,194 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.24978 seconds. 2021-08-20 01:00:32,206 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:32,209 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:32,227 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:00:32,234 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.09491 seconds. 2021-08-20 01:00:32,236 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.10125 seconds. 2021-08-20 01:00:32,280 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 113 iterations: 113 2021-08-20 01:00:32,286 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07683 seconds. 2021-08-20 01:00:32,288 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08206 seconds. 2021-08-20 01:00:32,667 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:32,776 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:32,915 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:32,917 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:32,919 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:33,027 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:33,029 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:33,031 C: 40% D:996.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:34,367 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.58831 seconds. 2021-08-20 01:00:34,380 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:34,382 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:34,462 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:00:34,473 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08854 seconds. 2021-08-20 01:00:34,477 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09544 seconds. 2021-08-20 01:00:34,483 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.81408 seconds. 2021-08-20 01:00:34,498 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:34,500 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:34,571 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:00:34,579 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07771 seconds. 2021-08-20 01:00:34,582 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08403 seconds. 2021-08-20 01:00:34,833 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:34,964 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:35,127 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:35,129 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:35,132 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:35,231 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:35,233 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:35,235 C: 34% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:35,865 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 4.8GB, since last ping: 22.3kB/s. CPU memory usage: 893.7MB, max: 893.7MB CPU: 439% Procs: 6 . GPU memory usage: 299.9MB, max: 299.9MB GPUs usage: 8% OpenFiles: 0/6291456 (OpenFilesUser: 0) PSThreads: 44 (Disk: Read: 0B/s Write: 172.4kB/s Size: 1.5MB) (Connections: 58 Fds: 298 WinHandles: 0 Threads: 32 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 29% Nice: 0% System: 13% Wait: 0% DAIActiveprocs: 5 DAIprocs: 52) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:target_transform_regressiontarget_transform_tuning_(iteration_0_batch_0-1_for_pop_size:_2)_train-training_xgb_indiv_1_fold_4] 2021-08-20 01:00:36,281 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.44783 seconds. 2021-08-20 01:00:36,292 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:36,295 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:36,361 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.39744 seconds. 2021-08-20 01:00:36,365 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:00:36,371 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07624 seconds. 2021-08-20 01:00:36,373 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08134 seconds. 2021-08-20 01:00:36,381 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:36,384 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:36,450 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:00:36,457 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07229 seconds. 2021-08-20 01:00:36,459 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08041 seconds. 2021-08-20 01:00:36,616 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:00:36,730 C: 40% D:996.3GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:36,873 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:37,554 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:37,556 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:37,558 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:37,582 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:37,584 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:37,587 C: 31% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:38,483 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.60973 seconds. 2021-08-20 01:00:38,494 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:38,496 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:38,569 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 113 iterations: 113 2021-08-20 01:00:38,576 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07862 seconds. 2021-08-20 01:00:38,578 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08480 seconds. 2021-08-20 01:00:38,629 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.89858 seconds. 2021-08-20 01:00:38,642 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:38,645 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:38,717 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:00:38,725 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07963 seconds. 2021-08-20 01:00:38,728 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08583 seconds. 2021-08-20 01:00:38,922 C: 31% D:996.3GB M:237.1GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:00:40,601 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 152, model transformed features: 15, total model time: 2.2211, fit model time: 2.22 2021-08-20 01:00:40,607 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 171, model transformed features: 15, total model time: 2.2865, fit model time: 2.2856 2021-08-20 01:00:40,608 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 1.8863, fit model time: 1.8851 2021-08-20 01:00:40,610 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 15, total model time: 1.8523, fit model time: 1.851 2021-08-20 01:00:40,612 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 119, model transformed features: 15, total model time: 1.7351, fit model time: 1.7169 2021-08-20 01:00:40,614 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 113, model transformed features: 15, total model time: 1.5368, fit model time: 1.5356 2021-08-20 01:00:40,615 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 171, model transformed features: 15, total model time: 1.9204, fit model time: 1.9188 2021-08-20 01:00:40,617 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 152, model transformed features: 15, total model time: 2.1009, fit model time: 2.1 2021-08-20 01:00:40,619 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 1.7299, fit model time: 1.7289 2021-08-20 01:00:40,621 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 15, total model time: 1.6897, fit model time: 1.6887 2021-08-20 01:00:40,622 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 113, model transformed features: 15, total model time: 1.8996, fit model time: 1.898 2021-08-20 01:00:40,624 C: 28% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 119, model transformed features: 15, total model time: 2.1811, fit model time: 2.1802 2021-08-20 01:00:41,708 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:00:41,829 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:00:41,855 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Experiment Progress: 0.443 % 2021-08-20 01:00:41,877 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Scored 3/598 models on 18 features. Last Scored [LIGHTGBM] 2021-08-20 01:00:41,881 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:00:41,883 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:00:41,885 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.638847 +/- 0.04907702 [Tournament: 1.638847 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:00:41,890 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:00:41,896 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:00:41,901 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:00:41,903 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:00:41,905 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:00:41,908 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:00:41,910 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:00:41,913 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:00:41,915 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:00:41,918 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:00:41,920 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:00:41,923 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:00:41,925 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:00:41,928 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Tuned 12/18 target transform tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:00:41,931 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:00:41,934 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:00:41,936 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Starting Iteration: 1 2021-08-20 01:00:41,939 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:00:42,275 C: 26% D:996.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:00:43,229 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:00:43,238 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 2, 10) 2021-08-20 01:00:43,241 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:00:43,464 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:00:43,562 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:43,747 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:43,749 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:43,751 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:43,846 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:43,849 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:43,851 C: 24% D:996.4GB M:239.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:44,823 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.35691 seconds. 2021-08-20 01:00:44,836 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:00:44,839 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:00:44,890 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.27726 seconds. 2021-08-20 01:00:44,902 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:44,905 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:44,956 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 114 iterations: 114 2021-08-20 01:00:44,964 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.12436 seconds. 2021-08-20 01:00:44,966 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.13046 seconds. 2021-08-20 01:00:44,973 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:00:44,980 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07431 seconds. 2021-08-20 01:00:44,982 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08006 seconds. 2021-08-20 01:00:45,453 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:45,575 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:00:45,794 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:45,796 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:45,799 C: 35% D:996.4GB M:237.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:45,852 C: 34% D:996.4GB M:237.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:45,860 C: 34% D:996.4GB M:237.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:45,862 C: 34% D:996.4GB M:237.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:47,062 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.48685 seconds. 2021-08-20 01:00:47,072 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:00:47,074 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:00:47,094 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.63939 seconds. 2021-08-20 01:00:47,108 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:47,111 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:47,141 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:00:47,151 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07463 seconds. 2021-08-20 01:00:47,154 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08140 seconds. 2021-08-20 01:00:47,174 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:00:47,181 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06981 seconds. 2021-08-20 01:00:47,184 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07553 seconds. 2021-08-20 01:00:47,490 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:47,654 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:00:47,724 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:47,726 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:47,728 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:47,919 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:47,921 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:47,923 C: 41% D:996.4GB M:236.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:48,721 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.06680 seconds. 2021-08-20 01:00:48,732 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:48,735 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:48,799 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:00:48,805 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07047 seconds. 2021-08-20 01:00:48,807 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07605 seconds. 2021-08-20 01:00:49,371 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.88094 seconds. 2021-08-20 01:00:49,383 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:00:49,385 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:00:49,453 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 115 iterations: 115 2021-08-20 01:00:49,460 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07475 seconds. 2021-08-20 01:00:49,463 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07986 seconds. 2021-08-20 01:00:49,671 C: 33% D:996.4GB M:236.1GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:00:51,153 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 114, model transformed features: 10, total model time: 1.6989, fit model time: 1.6979 2021-08-20 01:00:51,159 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 10, total model time: 1.5977, fit model time: 1.5968 2021-08-20 01:00:51,161 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 10, total model time: 1.7788, fit model time: 1.7779 2021-08-20 01:00:51,163 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 10, total model time: 1.9626, fit model time: 1.9613 2021-08-20 01:00:51,165 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 105, model transformed features: 10, total model time: 1.3495, fit model time: 1.3486 2021-08-20 01:00:51,167 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 115, model transformed features: 10, total model time: 2.1755, fit model time: 2.1744 2021-08-20 01:00:51,500 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.8284 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:00:52,004 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Munge time: 0.9836 s, Train time: 6.4296 s, Score time: 1.5908 s 2021-08-20 01:00:52,057 C: 29% D:996.4GB M:239.8GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:00:52,871 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:00:53,087 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:53,213 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:53,348 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_2': 1, 'InteractionSub:X_0:X_3': -1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:53,350 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionMul:X_0:X_1': '0.50024', 'InteractionMul:X_0:X_2': '0.28716', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:00:53,352 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806', 'InteractionSub:X_0:X_3': '-0.10377'} 2021-08-20 01:00:53,473 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:53,475 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_3': '0.70155', 'InteractionAdd:X_1:X_3': '0.68494', 'InteractionMul:X_0:X_1': '0.50019', 'InteractionMul:X_0:X_3': '0.65001', 'InteractionMul:X_1:X_3': '0.63161', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:00:53,477 C: 28% D:996.4GB M:240.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:54,318 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.10347 seconds. 2021-08-20 01:00:54,330 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:54,333 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:54,413 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 87 iterations: 87 2021-08-20 01:00:54,418 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08497 seconds. 2021-08-20 01:00:54,420 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09112 seconds. 2021-08-20 01:00:54,430 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.34609 seconds. 2021-08-20 01:00:54,441 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:54,443 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:54,511 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:00:54,517 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07348 seconds. 2021-08-20 01:00:54,520 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07895 seconds. 2021-08-20 01:00:54,741 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:54,903 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:00:55,025 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:55,027 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionAdd:X_0:X_3': '0.70521', 'InteractionAdd:X_1:X_3': '0.67883', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionMul:X_0:X_3': '0.64780', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:00:55,029 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:55,160 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:55,162 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionAdd:X_0:X_3': '0.69729', 'InteractionAdd:X_1:X_3': '0.69174', 'InteractionMul:X_0:X_3': '0.63628', 'InteractionMul:X_1:X_3': '0.64516', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:00:55,165 C: 37% D:996.4GB M:239.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:55,900 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.15916 seconds. 2021-08-20 01:00:55,911 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:55,914 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:55,987 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 109 iterations: 109 2021-08-20 01:00:55,992 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07817 seconds. 2021-08-20 01:00:55,995 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08330 seconds. 2021-08-20 01:00:56,106 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.20337 seconds. 2021-08-20 01:00:56,116 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:00:56,119 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:00:56,185 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 101 iterations: 101 2021-08-20 01:00:56,192 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07238 seconds. 2021-08-20 01:00:56,196 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07730 seconds. 2021-08-20 01:00:56,325 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:56,522 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:00:56,640 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_2:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_2:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:00:56,643 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_2:X_3': '0.42358', 'InteractionMul:X_0:X_1': '0.49996', 'InteractionMul:X_0:X_3': '0.63480', 'InteractionMul:X_2:X_3': '0.37896', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:00:56,645 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:56,765 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:00:56,767 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_3': '0.67252', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_0:X_3': '0.66064', 'InteractionMul:X_1:X_3': '0.62524', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:00:56,769 C: 34% D:996.4GB M:239.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:00:57,508 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.18009 seconds. 2021-08-20 01:00:57,519 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:57,522 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:57,590 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 77 iterations: 77 2021-08-20 01:00:57,595 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07392 seconds. 2021-08-20 01:00:57,598 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07932 seconds. 2021-08-20 01:00:57,777 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.25098 seconds. 2021-08-20 01:00:57,786 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:00:57,788 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:00:57,865 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:00:57,874 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08534 seconds. 2021-08-20 01:00:57,877 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09207 seconds. 2021-08-20 01:00:58,043 C: 36% D:996.4GB M:240.5GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:00:59,571 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 87, model transformed features: 15, total model time: 1.3989, fit model time: 1.3979 2021-08-20 01:00:59,577 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 15, total model time: 1.638, fit model time: 1.637 2021-08-20 01:00:59,578 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 109, model transformed features: 15, total model time: 1.4355, fit model time: 1.4347 2021-08-20 01:00:59,580 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 101, model transformed features: 15, total model time: 1.5034, fit model time: 1.5025 2021-08-20 01:00:59,582 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 77, model transformed features: 15, total model time: 1.4653, fit model time: 1.464 2021-08-20 01:00:59,584 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 15, total model time: 1.5284, fit model time: 1.5275 2021-08-20 01:00:59,931 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.7416 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:00,456 C: 19% D:996.4GB M:239.4GB NODE:LOCAL1 7646 INFO | Munge time: 0.8342 s, Train time: 5.1664 s, Score time: 1.6316 s 2021-08-20 01:01:00,629 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:01:00,786 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:01:00,812 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Experiment Progress: 0.59 % 2021-08-20 01:01:00,835 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Scored 4/598 models on 40 features. Last Scored [LIGHTGBM] 2021-08-20 01:01:00,841 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:01:00,844 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:01:00,846 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.741646 +/- 0.05843223 [Tournament: 1.741646 Model: LIGHTGBM Feature Cost: 22] 2021-08-20 01:01:00,852 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:01:00,860 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:01:00,865 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:01:00,868 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:01:00,870 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:01:00,872 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:01:00,875 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:01:00,878 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:01:00,880 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:01:00,883 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:01:00,885 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:01:00,888 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:01:00,891 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:01:00,895 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Tuned 18/18 target transform tuning models. Tuned [LIGHTGBM] Tuning [] 2021-08-20 01:01:00,983 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:01:01,086 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:01:01,123 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Target transform tuning leaderboard (score_f_name=RMSE): 2021-08-20 01:01:01,124 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:01,126 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+-----------------------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+------------+-----------+--------+ 2021-08-20 01:01:01,128 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | transformer | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:01:01,130 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | |-------------+--------------+----------------+--------------------+-----------------------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+------------+-----------+--------| 2021-08-20 01:01:01,132 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | 1 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity_noclip | 1.63852 | 0.0491097 | 11.5146 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | TargetTuning | 1.63852 | 1.63852 | 0.0491097 | 1.63852 | 1 | 1 | 11 | 100 | 17 | False | False | 0 | 0 | 1 | 1 | 3478.51 | 0 | * | + | 2021-08-20 01:01:01,134 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | 0 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_identity | 1.63885 | 0.049077 | 11.4943 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | TargetTuning | 1.63885 | 1.63885 | 0.049077 | 1.63885 | 0.998238 | 1 | 11 | 100 | 17 | False | False | 0 | 0 | 0.999799 | 0.999799 | 3478.51 | 0.00671663 | | + | 2021-08-20 01:01:01,136 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | | 2 | PASSED | TARGET_TUNING | LightGBMModel | TargetTransformer_center | 1.74165 | 0.0584322 | 8.9637 | 99 | 22 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, -1, 1, 1, 0, -1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | TargetTuning | 1.74165 | 1.74165 | 0.0584322 | 1.74165 | 0.778465 | 0.733333 | 11 | 100 | 22 | False | False | 0 | 0 | 0.940786 | 0.940786 | 2550.9 | 2.09997 | | | 2021-08-20 01:01:01,138 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+----------------+--------------------+-----------------------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-------------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+------------+-----------+--------+ 2021-08-20 01:01:01,172 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Target transform search: end : Duration: 389.6202 s 2021-08-20 01:01:01,354 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Target transform: TargetTransformer_identity_noclip 2021-08-20 01:01:01,359 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Model and feature tuning... 2021-08-20 01:01:01,495 C: 53% D:996.4GB M:237.5GB NODE:LOCAL1 7646 INFO | Forced tuning of these ON models: [] 2021-08-20 01:01:03,141 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,355 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,546 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,719 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:03,922 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,124 C: 61% D:996.4GB M:236.2GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,328 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,500 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 WARNING| Tuning default-type individual skipped because was invalid given experiment settings 2021-08-20 01:01:04,748 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=False accuracy=7 interpretability=8 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:05,244 C: 71% D:996.3GB M:235.9GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=False accuracy=7 interpretability=11 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:05,792 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=True accuracy=7 interpretability=8 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:06,039 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=True accuracy=2 interpretability=8 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:06,258 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting modified default individual: do_target_encoding=True accuracy=7 interpretability=11 num_as_cat=False booster=lightgbm model_class_name=LightGBMModel special=False 2021-08-20 01:01:06,481 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting 3 modified default individuals with boosters: {'lightgbm'} 2021-08-20 01:01:06,483 C: 65% D:996.2GB M:235.6GB NODE:LOCAL1 7646 INFO | Inserting 1 original best individual 2021-08-20 01:01:07,358 C: 70% D:996.2GB M:235.5GB NODE:LOCAL1 7646 INFO | best individual has sim_score=0 for H2O.ai brain caching /opt/h2oai/dai/tmp/n/H2O.ai_brain/best_individual.4b19926e-ffa8-11eb-b231-0242c0a8fe02.ret_353750d7-600d-42d7-afbe-5cf13c7df769.pickle 2021-08-20 01:01:08,007 C: 70% D:996.2GB M:235.5GB NODE:LOCAL1 7646 INFO | best individual has sim_score=0 for H2O.ai brain caching /opt/h2oai/dai/tmp/n/H2O.ai_brain/best_individual.465e7758-ffa3-11eb-b231-0242c0a8fe02.ret_ad1c4d35-b4c9-4b6a-b143-7b45d9ac6210.pickle 2021-08-20 01:01:08,664 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Brain cache found 2 matching individuals and will use best 2 individuals for this experiment. 2021-08-20 01:01:08,670 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Brain original scores [which will be re-scored, if not restarting or have different scorer or features changed]: 2021-08-20 01:01:08,672 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ['1.532119 +/- 0.0848579 [RMSE] using LightGBMModel', '1.564021 +/- 0.107501 [RMSE] using LightGBMModel'] 2021-08-20 01:01:08,674 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Brain new scores [nan means needs to be re-scored]: 2021-08-20 01:01:08,676 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ['nan +/- nan [RMSE] using LightGBMModel', 'nan +/- nan [RMSE] using LightGBMModel'] 2021-08-20 01:01:08,683 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Parameter & feature tuning iterations: 5 2021-08-20 01:01:08,686 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Tuned 0/54 Parameter & feature tuning models. Tuning [LIGHTGBM] 2021-08-20 01:01:08,688 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:08,691 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:08,693 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Starting Iteration: 2 2021-08-20 01:01:08,696 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:08,770 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Engineering features (for 0/2 base individual models out of 0 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:08,778 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 0 munging tasks out of 0 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:08,799 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 2 training tasks out of 0 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:09,068 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:09,530 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Munge time: 0.0234 s, Train time: 0.0159 s, Score time: 0.0287 s 2021-08-20 01:01:09,568 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Engineering features (for 0/2 base individual models out of 0 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:09,577 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 0 munging tasks out of 0 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:09,603 C: 68% D:996.2GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 2 training tasks out of 0 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:09,896 C: 71% D:996.1GB M:236.3GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:10,368 C: 71% D:996.1GB M:236.3GB NODE:LOCAL1 7646 INFO | Munge time: 0.0279 s, Train time: 0.0173 s, Score time: 0.0324 s 2021-08-20 01:01:10,543 C: 71% D:996.1GB M:236.3GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:01:10,898 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:01:10,919 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.1 % 2021-08-20 01:01:10,932 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Scored 21/598 models on 45 features. Last Scored [] 2021-08-20 01:01:10,939 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:01:10,941 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:01:10,948 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:01:10,954 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:01:10,959 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:01:10,961 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:01:10,963 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:01:10,966 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:01:10,968 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:01:10,970 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:01:10,973 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:01:10,975 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:01:10,977 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:01:10,980 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:01:10,982 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:01:10,985 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Tuned 0/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:01:10,988 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:10,991 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:10,993 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Starting Iteration: 3 2021-08-20 01:01:10,995 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:11,207 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Pre-pruning 1 gene(s) from 11 active base genes 2021-08-20 01:01:11,430 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Pre-pruning 1 gene(s) from 11 active base genes 2021-08-20 01:01:11,572 C: 68% D:996.1GB M:235.2GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:13,514 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 INFO | Completed 120 munging tasks out of 120 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:13,529 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:01:13,533 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:13,538 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348886', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 01:01:13,543 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:13,830 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:13,952 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:14,173 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:14,177 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:14,179 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:14,234 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:14,236 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:14,239 C: 70% D:996.0GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:15,079 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.25012 seconds. 2021-08-20 01:01:15,094 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:15,098 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:15,187 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 79 iterations: 79 2021-08-20 01:01:15,209 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.11127 seconds. 2021-08-20 01:01:15,212 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.11880 seconds. 2021-08-20 01:01:15,614 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:15,953 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:15,955 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:15,958 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:16,057 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 2.10157 seconds. 2021-08-20 01:01:16,075 C: 77% D:996.0GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:16,079 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:16,158 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:01:16,167 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08776 seconds. 2021-08-20 01:01:16,170 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09557 seconds. 2021-08-20 01:01:16,610 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:16,984 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.37286 seconds. 2021-08-20 01:01:17,009 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:17,014 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:17,047 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:17,049 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:17,053 C: 80% D:995.8GB M:231.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:17,109 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:01:17,154 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.14022 seconds. 2021-08-20 01:01:17,166 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.14987 seconds. 2021-08-20 01:01:17,804 C: 85% D:995.8GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:18,486 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:18,503 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:18,505 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:19,102 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 2.48831 seconds. 2021-08-20 01:01:19,120 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:19,124 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:19,222 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 89 iterations: 89 2021-08-20 01:01:19,231 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.10632 seconds. 2021-08-20 01:01:19,236 C: 95% D:995.8GB M:235.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.11445 seconds. 2021-08-20 01:01:19,518 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.71451 seconds. 2021-08-20 01:01:19,541 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:19,545 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:19,651 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 83 iterations: 83 2021-08-20 01:01:19,714 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.16598 seconds. 2021-08-20 01:01:19,718 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.17664 seconds. 2021-08-20 01:01:19,747 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:20,113 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:20,116 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:20,119 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:20,124 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:20,470 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:20,474 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:20,479 C: 88% D:995.7GB M:234.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:21,038 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.29348 seconds. 2021-08-20 01:01:21,052 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:21,056 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:21,130 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:01:21,138 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08159 seconds. 2021-08-20 01:01:21,140 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08869 seconds. 2021-08-20 01:01:21,407 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.28186 seconds. 2021-08-20 01:01:21,423 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:21,426 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:21,513 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 63 iterations: 63 2021-08-20 01:01:21,521 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.09318 seconds. 2021-08-20 01:01:21,524 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.10068 seconds. 2021-08-20 01:01:21,555 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:21,920 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:21,928 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:21,944 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:21,987 C: 82% D:995.7GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:22,457 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:22,465 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:22,467 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:22,827 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.27080 seconds. 2021-08-20 01:01:22,845 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:22,850 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:22,930 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 68 iterations: 68 2021-08-20 01:01:22,941 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.09195 seconds. 2021-08-20 01:01:22,944 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.10069 seconds. 2021-08-20 01:01:23,366 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:01:23,427 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.44246 seconds. 2021-08-20 01:01:23,443 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:23,447 C: 84% D:995.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:23,519 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 77 iterations: 77 2021-08-20 01:01:23,525 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07823 seconds. 2021-08-20 01:01:23,527 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08529 seconds. 2021-08-20 01:01:23,739 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:23,741 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:23,743 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:23,793 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:23,931 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:24,261 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:24,265 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:24,285 C: 82% D:995.6GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:24,729 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 1.36285 seconds. 2021-08-20 01:01:24,746 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:01:24,751 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:01:24,836 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:01:24,844 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.09317 seconds. 2021-08-20 01:01:24,849 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.10141 seconds. 2021-08-20 01:01:25,028 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.09649 seconds. 2021-08-20 01:01:25,040 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:25,043 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:25,125 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 71 iterations: 71 2021-08-20 01:01:25,133 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08941 seconds. 2021-08-20 01:01:25,137 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.09616 seconds. 2021-08-20 01:01:25,291 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:01:25,668 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:25,671 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:25,674 C: 81% D:995.5GB M:233.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:26,392 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 1.10185 seconds. 2021-08-20 01:01:26,403 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:01:26,406 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:01:26,474 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 59 iterations: 59 2021-08-20 01:01:26,479 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07315 seconds. 2021-08-20 01:01:26,482 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.07880 seconds. 2021-08-20 01:01:26,679 C: 73% D:995.5GB M:233.7GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:28,558 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 79, model transformed features: 9, total model time: 1.6279, fit model time: 1.627 2021-08-20 01:01:28,566 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 100, model transformed features: 9, total model time: 2.4083, fit model time: 2.4073 2021-08-20 01:01:28,568 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 97, model transformed features: 9, total model time: 1.8189, fit model time: 1.8177 2021-08-20 01:01:28,570 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 89, model transformed features: 9, total model time: 2.8839, fit model time: 2.8829 2021-08-20 01:01:28,572 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 83, model transformed features: 9, total model time: 2.2429, fit model time: 2.2421 2021-08-20 01:01:28,574 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 9, total model time: 1.6186, fit model time: 1.6178 2021-08-20 01:01:28,576 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 63, model transformed features: 9, total model time: 1.6421, fit model time: 1.641 2021-08-20 01:01:28,578 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 68, model transformed features: 9, total model time: 1.609, fit model time: 1.6081 2021-08-20 01:01:28,580 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 77, model transformed features: 9, total model time: 1.7876, fit model time: 1.7867 2021-08-20 01:01:28,582 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 84, model transformed features: 9, total model time: 1.7373, fit model time: 1.7358 2021-08-20 01:01:28,584 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 71, model transformed features: 9, total model time: 1.4014, fit model time: 1.4006 2021-08-20 01:01:28,586 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 59, model transformed features: 9, total model time: 1.4244, fit model time: 1.4233 2021-08-20 01:01:28,976 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=2.2084 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:01:29,029 C: 76% D:995.6GB M:235.9GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=2.9734 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:01:29,809 C: 68% D:995.5GB M:235.6GB NODE:LOCAL1 7646 INFO | Munge time: 1.9937 s, Train time: 13.1364 s, Score time: 2.0284 s 2021-08-20 01:01:29,884 C: 68% D:995.5GB M:235.6GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:31,807 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 INFO | Completed 120 munging tasks out of 120 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:32,108 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:32,170 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:32,465 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:32,468 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:32,472 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:01:32,608 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:32,611 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:32,615 C: 74% D:995.5GB M:233.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:01:33,508 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.39938 seconds. 2021-08-20 01:01:33,525 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:33,529 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:33,607 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 81 iterations: 81 2021-08-20 01:01:33,615 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.08567 seconds. 2021-08-20 01:01:33,621 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.09522 seconds. 2021-08-20 01:01:34,091 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:34,163 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.99272 seconds. 2021-08-20 01:01:34,186 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:34,191 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:34,287 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:01:34,306 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.11379 seconds. 2021-08-20 01:01:34,310 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.12360 seconds. 2021-08-20 01:01:34,434 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:34,439 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:34,441 C: 84% D:995.4GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:01:34,767 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:35,118 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:35,121 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:35,124 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:01:35,360 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.26911 seconds. 2021-08-20 01:01:35,374 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:35,378 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:35,461 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 86 iterations: 86 2021-08-20 01:01:35,471 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09297 seconds. 2021-08-20 01:01:35,486 C: 82% D:995.4GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10038 seconds. 2021-08-20 01:01:35,908 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:36,017 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.24962 seconds. 2021-08-20 01:01:36,029 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:36,032 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:36,133 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 77 iterations: 77 2021-08-20 01:01:36,145 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.10787 seconds. 2021-08-20 01:01:36,150 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.11865 seconds. 2021-08-20 01:01:36,260 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:36,263 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:36,266 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:01:36,531 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:36,870 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:36,873 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:36,875 C: 83% D:995.4GB M:232.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:01:37,125 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.21573 seconds. 2021-08-20 01:01:37,138 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:37,141 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:37,214 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 70 iterations: 70 2021-08-20 01:01:37,228 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08487 seconds. 2021-08-20 01:01:37,231 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.09262 seconds. 2021-08-20 01:01:37,637 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:38,072 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.53999 seconds. 2021-08-20 01:01:38,085 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:38,096 C: 78% D:995.3GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:38,186 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:01:38,201 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.11250 seconds. 2021-08-20 01:01:38,205 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.11950 seconds. 2021-08-20 01:01:38,595 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:38,653 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:38,660 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:38,662 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:01:39,034 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:39,039 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:39,043 C: 82% D:995.3GB M:232.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:01:40,372 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.77109 seconds. 2021-08-20 01:01:40,390 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:40,393 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:40,413 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 2.77110 seconds. 2021-08-20 01:01:40,440 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:40,443 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:40,480 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 92 iterations: 92 2021-08-20 01:01:40,488 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09350 seconds. 2021-08-20 01:01:40,492 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10114 seconds. 2021-08-20 01:01:40,517 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 131 iterations: 131 2021-08-20 01:01:40,524 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.08070 seconds. 2021-08-20 01:01:40,528 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.08774 seconds. 2021-08-20 01:01:40,874 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:41,067 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:01:41,200 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:41,202 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:41,204 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:01:41,364 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:41,367 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:41,369 C: 90% D:995.2GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:01:41,387 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 5.6GB, since last ping: 5.5MB/s. CPU memory usage: 467.0MB, max: 893.7MB CPU: 249% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 21 (Disk: Read: 0B/s Write: 290.0kB/s Size: 2.7MB) (Connections: 58 Fds: 317 WinHandles: 0 Threads: 39 Maps: 4016 WinOpenFiles: 0) (System-Wide CPU: User: 67% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 22 DAIprocs: 70) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_3_batch_2-3_for_pop_size:_8)_train-training_xgb_indiv_1_fold_4] 2021-08-20 01:01:42,361 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.48468 seconds. 2021-08-20 01:01:42,377 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:42,380 C: 76% D:995.2GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:42,450 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:01:42,458 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07748 seconds. 2021-08-20 01:01:42,462 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08419 seconds. 2021-08-20 01:01:42,741 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:42,771 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.70190 seconds. 2021-08-20 01:01:42,787 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:01:42,791 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:01:42,861 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:42,884 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:01:42,893 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.10255 seconds. 2021-08-20 01:01:42,896 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.11008 seconds. 2021-08-20 01:01:43,127 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:43,129 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:43,132 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:01:43,277 C: 84% D:995.2GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:01:43,695 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:43,702 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:43,704 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:01:44,073 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.21056 seconds. 2021-08-20 01:01:44,090 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:44,092 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:44,178 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 01:01:44,186 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09485 seconds. 2021-08-20 01:01:44,189 C: 75% D:995.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10242 seconds. 2021-08-20 01:01:45,149 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.87076 seconds. 2021-08-20 01:01:45,163 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:01:45,167 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:01:45,249 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 147 iterations: 147 2021-08-20 01:01:45,264 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.09624 seconds. 2021-08-20 01:01:45,268 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.10446 seconds. 2021-08-20 01:01:45,513 C: 80% D:995.1GB M:233.5GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:01:47,539 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 81, model transformed features: 13, total model time: 1.7657, fit model time: 1.7646 2021-08-20 01:01:47,546 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 13, total model time: 2.3801, fit model time: 2.379 2021-08-20 01:01:47,551 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 86, model transformed features: 13, total model time: 1.617, fit model time: 1.6161 2021-08-20 01:01:47,553 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 77, model transformed features: 13, total model time: 1.6219, fit model time: 1.621 2021-08-20 01:01:47,555 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 70, model transformed features: 13, total model time: 1.5386, fit model time: 1.5375 2021-08-20 01:01:47,557 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 104, model transformed features: 13, total model time: 1.9091, fit model time: 1.9077 2021-08-20 01:01:47,558 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 92, model transformed features: 13, total model time: 2.1162, fit model time: 2.1151 2021-08-20 01:01:47,570 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 131, model transformed features: 13, total model time: 3.1048, fit model time: 3.1034 2021-08-20 01:01:47,572 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 108, model transformed features: 13, total model time: 1.7765, fit model time: 1.7754 2021-08-20 01:01:47,574 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 13, total model time: 2.0376, fit model time: 2.0365 2021-08-20 01:01:47,576 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 13, total model time: 1.5176, fit model time: 1.5163 2021-08-20 01:01:47,578 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 147, model transformed features: 13, total model time: 2.2165, fit model time: 2.2152 2021-08-20 01:01:47,960 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=2.0802 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:48,024 C: 78% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:01:48,652 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Munge time: 1.9537 s, Train time: 13.6941 s, Score time: 2.1724 s 2021-08-20 01:01:48,812 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:01:49,170 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:01:49,224 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.39 % 2021-08-20 01:01:49,265 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Scored 23/598 models on 59 features. Last Scored [LIGHTGBM] 2021-08-20 01:01:49,275 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:01:49,278 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:01:49,280 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:01:49,282 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Individual 2 : 2.080228 +/- 0.03523514 [Tournament: 2.080228 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:01:49,289 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:01:49,298 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:01:49,306 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:01:49,309 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:01:49,313 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:01:49,317 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:01:49,320 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:01:49,324 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:01:49,328 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:01:49,331 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:01:49,335 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:01:49,338 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:01:49,341 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:01:49,346 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Tuned 12/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:01:49,350 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:01:49,353 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:49,356 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | Starting Iteration: 4 2021-08-20 01:01:49,360 C: 73% D:995.0GB M:232.3GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:01:49,668 C: 75% D:994.9GB M:232.4GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:01:50,548 C: 75% D:994.9GB M:232.4GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:01:51,373 C: 74% D:994.9GB M:235.6GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:01:53,719 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:01:53,729 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:01:53,733 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:53,737 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 01:01:53,741 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:01:54,644 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:54,648 C: 77% D:994.8GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:01:54,955 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:54,961 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:54,963 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:54,977 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:54,979 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:54,982 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:55,558 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.91391 seconds. 2021-08-20 01:01:55,575 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:55,577 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:55,659 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 164 iterations: 164 2021-08-20 01:01:55,667 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08816 seconds. 2021-08-20 01:01:55,670 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09559 seconds. 2021-08-20 01:01:55,682 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.03621 seconds. 2021-08-20 01:01:55,694 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:01:55,697 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:01:55,765 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 196 iterations: 196 2021-08-20 01:01:55,772 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07472 seconds. 2021-08-20 01:01:55,775 C: 75% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08094 seconds. 2021-08-20 01:01:56,038 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:56,238 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:01:56,372 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:56,374 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:01:56,377 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:56,544 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:56,546 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:01:56,550 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:56,910 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.87272 seconds. 2021-08-20 01:01:56,920 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:56,923 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:57,006 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 151 iterations: 151 2021-08-20 01:01:57,012 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08868 seconds. 2021-08-20 01:01:57,015 C: 77% D:994.7GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09428 seconds. 2021-08-20 01:01:57,054 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 0.81610 seconds. 2021-08-20 01:01:57,067 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:01:57,071 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:01:57,150 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 161 iterations: 161 2021-08-20 01:01:57,157 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08586 seconds. 2021-08-20 01:01:57,161 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09311 seconds. 2021-08-20 01:01:57,389 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:57,570 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:57,694 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:57,696 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:01:57,698 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:57,870 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:01:57,874 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:01:57,878 C: 78% D:994.7GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:58,256 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.86758 seconds. 2021-08-20 01:01:58,273 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:58,275 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:58,361 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:01:58,372 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09502 seconds. 2021-08-20 01:01:58,377 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.10262 seconds. 2021-08-20 01:01:58,426 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 0.85666 seconds. 2021-08-20 01:01:58,437 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:01:58,440 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:01:58,521 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 167 iterations: 167 2021-08-20 01:01:58,533 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09144 seconds. 2021-08-20 01:01:58,536 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09825 seconds. 2021-08-20 01:01:58,745 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:01:58,950 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:01:59,045 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:59,049 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:01:59,051 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:01:59,238 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:01:59,244 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:01:59,247 C: 79% D:994.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:00,286 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.53947 seconds. 2021-08-20 01:02:00,302 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:02:00,307 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:02:00,399 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:02:00,405 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09860 seconds. 2021-08-20 01:02:00,407 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.10634 seconds. 2021-08-20 01:02:00,646 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.68860 seconds. 2021-08-20 01:02:00,669 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:00,676 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:00,764 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 01:02:00,770 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09615 seconds. 2021-08-20 01:02:00,773 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.10567 seconds. 2021-08-20 01:02:00,791 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:01,102 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:01,106 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:02:01,109 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:01,163 C: 87% D:994.6GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:02:01,490 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:01,496 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:02:01,497 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:02,222 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.42997 seconds. 2021-08-20 01:02:02,234 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:02,237 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:02,307 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 01:02:02,316 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07708 seconds. 2021-08-20 01:02:02,319 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08409 seconds. 2021-08-20 01:02:02,462 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.29963 seconds. 2021-08-20 01:02:02,473 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:02:02,476 C: 77% D:994.4GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:02:02,559 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:02:02,567 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09012 seconds. 2021-08-20 01:02:02,571 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09655 seconds. 2021-08-20 01:02:02,715 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:03,009 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:03,012 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:02:03,015 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:03,019 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:03,367 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:02:03,369 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:02:03,372 C: 80% D:994.4GB M:233.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:04,043 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.32641 seconds. 2021-08-20 01:02:04,059 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:04,063 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:04,191 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 01:02:04,227 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.16411 seconds. 2021-08-20 01:02:04,230 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.17221 seconds. 2021-08-20 01:02:04,786 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.73307 seconds. 2021-08-20 01:02:04,839 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:02:04,843 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:02:04,935 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:02:04,958 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.11380 seconds. 2021-08-20 01:02:04,960 C: 81% D:994.4GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.12178 seconds. 2021-08-20 01:02:05,262 C: 88% D:994.3GB M:233.7GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:02:07,310 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 164, model transformed features: 10, total model time: 1.6802, fit model time: 1.6793 2021-08-20 01:02:07,318 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 196, model transformed features: 10, total model time: 1.9729, fit model time: 1.9719 2021-08-20 01:02:07,320 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 151, model transformed features: 10, total model time: 1.1765, fit model time: 1.1757 2021-08-20 01:02:07,322 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 161, model transformed features: 10, total model time: 1.1373, fit model time: 1.1365 2021-08-20 01:02:07,324 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 150, model transformed features: 10, total model time: 1.2223, fit model time: 1.2214 2021-08-20 01:02:07,326 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 167, model transformed features: 10, total model time: 1.1826, fit model time: 1.1812 2021-08-20 01:02:07,328 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 1.8762, fit model time: 1.8749 2021-08-20 01:02:07,330 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 2.0619, fit model time: 2.0605 2021-08-20 01:02:07,332 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 1.7478, fit model time: 1.7469 2021-08-20 01:02:07,334 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 1.6617, fit model time: 1.66 2021-08-20 01:02:07,336 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 1.7665, fit model time: 1.7652 2021-08-20 01:02:07,338 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 2.2315, fit model time: 2.2304 2021-08-20 01:02:07,745 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.7663 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:02:07,790 C: 73% D:994.2GB M:233.4GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.8349 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:02:08,686 C: 70% D:994.2GB M:233.0GB NODE:LOCAL1 7646 INFO | Munge time: 2.3927 s, Train time: 11.5141 s, Score time: 2.2382 s 2021-08-20 01:02:08,754 C: 70% D:994.2GB M:233.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:02:09,662 C: 70% D:994.2GB M:233.0GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:02:09,911 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:10,061 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:10,180 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:10,184 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_0:X_3': '0.69742', 'InteractionMul:X_0:X_1': '0.50024', 'InteractionMul:X_0:X_3': '0.63392', 'InteractionMul:X_1:X_3': '0.63112', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:02:10,188 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:10,365 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:10,368 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_0:X_3': '0.70155', 'InteractionMul:X_0:X_1': '0.50019', 'InteractionMul:X_0:X_3': '0.65001', 'InteractionMul:X_1:X_3': '0.63161', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:02:10,371 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:10,762 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 0.70044 seconds. 2021-08-20 01:02:10,775 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:10,779 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:10,860 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 129 iterations: 129 2021-08-20 01:02:10,866 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08715 seconds. 2021-08-20 01:02:10,868 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09484 seconds. 2021-08-20 01:02:10,871 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 0.96006 seconds. 2021-08-20 01:02:10,881 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:10,884 C: 63% D:994.2GB M:232.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:10,949 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 143 iterations: 143 2021-08-20 01:02:10,966 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07035 seconds. 2021-08-20 01:02:10,968 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07585 seconds. 2021-08-20 01:02:11,214 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:11,356 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:11,475 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:11,477 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionAdd:X_0:X_3': '0.70521', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionMul:X_0:X_3': '0.64780', 'InteractionMul:X_1:X_3': '0.63433', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:02:11,479 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:11,632 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionAdd:X_1:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:11,635 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionAdd:X_0:X_3': '0.69729', 'InteractionAdd:X_1:X_3': '0.69174', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionMul:X_1:X_3': '0.64516', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:02:11,639 C: 56% D:994.1GB M:231.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:12,077 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 0.86302 seconds. 2021-08-20 01:02:12,093 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:12,095 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:12,157 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 112 iterations: 112 2021-08-20 01:02:12,163 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07210 seconds. 2021-08-20 01:02:12,165 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07778 seconds. 2021-08-20 01:02:12,201 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 0.84453 seconds. 2021-08-20 01:02:12,211 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:12,214 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:12,298 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 172 iterations: 172 2021-08-20 01:02:12,304 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.08955 seconds. 2021-08-20 01:02:12,306 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.09465 seconds. 2021-08-20 01:02:12,488 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:12,648 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:12,746 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:12,749 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_0:X_3': '0.69614', 'InteractionMul:X_0:X_1': '0.49996', 'InteractionMul:X_0:X_3': '0.63480', 'InteractionMul:X_1:X_3': '0.62623', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:02:12,751 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:12,966 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_0:X_3': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_0:X_3': 1, 'InteractionMul:X_1:X_3': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:02:12,968 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_0:X_3': '0.71067', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_0:X_3': '0.66064', 'InteractionMul:X_1:X_3': '0.62524', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:02:12,970 C: 50% D:994.3GB M:233.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:13,199 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 0.71178 seconds. 2021-08-20 01:02:13,210 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:13,212 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:13,276 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 141 iterations: 141 2021-08-20 01:02:13,280 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.06803 seconds. 2021-08-20 01:02:13,282 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07266 seconds. 2021-08-20 01:02:13,627 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:13,760 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.11154 seconds. 2021-08-20 01:02:13,771 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:13,773 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:13,845 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:02:13,850 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07695 seconds. 2021-08-20 01:02:13,852 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08232 seconds. 2021-08-20 01:02:13,874 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:13,876 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:02:13,878 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:14,196 C: 48% D:994.3GB M:233.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:14,468 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:14,475 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:02:14,477 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:15,319 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.69173 seconds. 2021-08-20 01:02:15,331 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:15,333 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:15,400 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 152 iterations: 152 2021-08-20 01:02:15,409 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07490 seconds. 2021-08-20 01:02:15,414 C: 53% D:994.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08045 seconds. 2021-08-20 01:02:15,756 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:15,985 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.78711 seconds. 2021-08-20 01:02:15,996 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:15,999 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:16,072 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:02:16,081 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08129 seconds. 2021-08-20 01:02:16,084 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08714 seconds. 2021-08-20 01:02:16,412 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:02:16,569 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:16,572 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:02:16,575 C: 61% D:994.3GB M:235.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:16,771 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:16,778 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:02:16,779 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:17,716 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.95910 seconds. 2021-08-20 01:02:17,727 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:17,729 C: 46% D:994.3GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:17,817 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:02:17,826 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.09515 seconds. 2021-08-20 01:02:17,831 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.10187 seconds. 2021-08-20 01:02:17,860 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.44834 seconds. 2021-08-20 01:02:17,871 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:02:17,873 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:02:17,942 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:02:17,950 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07561 seconds. 2021-08-20 01:02:17,953 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08171 seconds. 2021-08-20 01:02:18,276 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:18,452 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:02:18,534 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:02:18,536 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:02:18,539 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:18,723 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:02:18,726 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:02:18,728 C: 47% D:994.0GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:02:19,617 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.34085 seconds. 2021-08-20 01:02:19,628 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:19,630 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:19,675 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.22154 seconds. 2021-08-20 01:02:19,686 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:02:19,688 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:02:19,704 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:02:19,714 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08276 seconds. 2021-08-20 01:02:19,716 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08814 seconds. 2021-08-20 01:02:19,755 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 113 iterations: 113 2021-08-20 01:02:19,762 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07354 seconds. 2021-08-20 01:02:19,764 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07875 seconds. 2021-08-20 01:02:19,957 C: 37% D:994.0GB M:234.4GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:02:21,641 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 129, model transformed features: 15, total model time: 1.0079, fit model time: 1.0069 2021-08-20 01:02:21,649 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 143, model transformed features: 15, total model time: 1.2544, fit model time: 1.2535 2021-08-20 01:02:21,651 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 112, model transformed features: 15, total model time: 1.1386, fit model time: 1.1377 2021-08-20 01:02:21,653 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 172, model transformed features: 15, total model time: 1.1413, fit model time: 1.1404 2021-08-20 01:02:21,655 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 141, model transformed features: 15, total model time: 0.97604, fit model time: 0.97483 2021-08-20 01:02:21,657 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 139, model transformed features: 15, total model time: 1.3805, fit model time: 1.3797 2021-08-20 01:02:21,660 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 152, model transformed features: 15, total model time: 1.9884, fit model time: 1.987 2021-08-20 01:02:21,662 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 171, model transformed features: 15, total model time: 2.1022, fit model time: 2.101 2021-08-20 01:02:21,664 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 2.2804, fit model time: 2.2792 2021-08-20 01:02:21,666 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 125, model transformed features: 15, total model time: 1.7206, fit model time: 1.7196 2021-08-20 01:02:21,668 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 119, model transformed features: 15, total model time: 1.6258, fit model time: 1.6245 2021-08-20 01:02:21,670 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 113, model transformed features: 15, total model time: 1.4878, fit model time: 1.4869 2021-08-20 01:02:21,995 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6909 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:02:22,028 C: 28% D:993.9GB M:238.1GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:02:22,860 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Munge time: 0.9305 s, Train time: 10.2872 s, Score time: 1.8307 s 2021-08-20 01:02:23,020 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:02:23,368 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:02:23,402 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.69 % 2021-08-20 01:02:23,427 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Scored 25/598 models on 80 features. Last Scored [LIGHTGBM] 2021-08-20 01:02:23,434 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:02:23,436 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638488 +/- 0.04910973 [Tournament: 1.638488 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:02:23,438 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.690918 +/- 0.05417363 [Tournament: 1.690918 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:02:23,444 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638488 RMSE 2021-08-20 01:02:23,450 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:02:23,455 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:02:23,458 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:02:23,460 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:02:23,463 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:02:23,465 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:02:23,468 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:02:23,470 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:02:23,472 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:02:23,475 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:02:23,477 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:02:23,479 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:02:23,483 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Tuned 24/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:02:23,485 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:02:23,488 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:02:23,491 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Starting Iteration: 5 2021-08-20 01:02:23,493 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:02:23,733 C: 25% D:993.9GB M:237.5GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:02:24,547 C: 24% D:993.9GB M:237.2GB NODE:LOCAL1 7646 INFO | Pre-adding 2 gene(s) to 11 active base genes 2021-08-20 01:02:25,274 C: 24% D:993.9GB M:237.2GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:02:26,909 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:02:26,918 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:02:26,921 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:02:26,924 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (1, 0, 10) 2021-08-20 01:02:26,926 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:02:27,197 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:02:27,316 C: 22% D:993.9GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:02:48,153 C: 31% D:994.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 8.5GB, since last ping: 5.7MB/s. CPU memory usage: 614.4MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.2kB/s Size: 3.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 14% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 2 DAIprocs: 50) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_0_fold_2] 2021-08-20 01:03:55,290 C: 66% D:993.3GB M:237.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 9.4GB, since last ping: 31.3kB/s. CPU memory usage: 616.6MB, max: 894.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.4kB/s Size: 3.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3990 WinOpenFiles: 0) (System-Wide CPU: User: 56% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 2 DAIprocs: 53) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_0_fold_2] 2021-08-20 01:04:11,403 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:11,410 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:04:11,411 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:11,960 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 104.64233 seconds. 2021-08-20 01:04:11,973 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:04:11,977 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:04:12,066 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:04:12,077 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.09862 seconds. 2021-08-20 01:04:12,082 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.10761 seconds. 2021-08-20 01:04:12,382 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 2 3 and Completed 1 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:04:12,385 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:04:12,388 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 DATA | Time: 105.365 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 8, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.3, 'subsample': 0.8, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 8, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None} 2021-08-20 01:04:12,391 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:04:12,393 C: 45% D:992.4GB M:237.2GB NODE:LOCAL1 7646 INFO | Time: 105.365 s: LIGHTGBM 2021-08-20 01:04:12,527 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:04:12,600 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:12,602 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:04:12,605 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:13,200 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 106.00403 seconds. 2021-08-20 01:04:13,212 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:04:13,214 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:04:13,280 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:04:13,287 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07193 seconds. 2021-08-20 01:04:13,289 C: 58% D:992.4GB M:236.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07699 seconds. 2021-08-20 01:04:13,635 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:04:13,643 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:13,646 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:04:13,648 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:14,070 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.54288 seconds. 2021-08-20 01:04:14,081 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:04:14,083 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:04:14,151 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:04:14,156 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07305 seconds. 2021-08-20 01:04:14,159 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07801 seconds. 2021-08-20 01:04:14,547 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:04:14,586 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:04:14,589 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:04:14,591 C: 34% D:992.4GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:04:15,024 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.38729 seconds. 2021-08-20 01:04:15,035 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:04:15,037 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:04:15,104 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:04:15,111 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07268 seconds. 2021-08-20 01:04:15,113 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07858 seconds. 2021-08-20 01:04:15,445 C: 35% D:992.4GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:05:02,042 C: 67% D:990.3GB M:235.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 12.7GB, since last ping: 29.1MB/s. CPU memory usage: 615.3MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.0kB/s Size: 3.0MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4005 WinOpenFiles: 0) (System-Wide CPU: User: 57% Nice: 0% System: 7% Wait: 3% DAIActiveprocs: 1 DAIprocs: 56) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_0] 2021-08-20 01:05:33,774 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:05:33,782 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:05:33,784 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:05:34,265 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 79.71798 seconds. 2021-08-20 01:05:34,275 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:05:34,277 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:05:34,351 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:05:34,358 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07975 seconds. 2021-08-20 01:05:34,360 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08452 seconds. 2021-08-20 01:05:34,621 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 0 7 and Completed 5 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:05:34,624 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:05:34,627 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Time: 79.3109 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.05, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 8, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.3, 'subsample': 0.8, 'subsample_freq': 20, 'reg_lambda': 1e-06, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 8, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'gpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None} 2021-08-20 01:05:34,630 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:05:34,632 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 INFO | Time: 79.3109 s: LIGHTGBM 2021-08-20 01:05:34,646 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:05:34,648 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:05:34,651 C: 29% D:990.6GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:05:34,811 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:05:35,054 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 79.60826 seconds. 2021-08-20 01:05:35,066 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:05:35,068 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:05:35,134 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:05:35,140 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07212 seconds. 2021-08-20 01:05:35,142 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07689 seconds. 2021-08-20 01:05:35,490 C: 29% D:990.6GB M:237.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:06:09,745 C: 50% D:989.5GB M:234.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 14.7GB, since last ping: 2.3MB/s. CPU memory usage: 614.3MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.1kB/s Size: 3.0MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4000 WinOpenFiles: 0) (System-Wide CPU: User: 59% Nice: 0% System: 9% Wait: 0% DAIActiveprocs: 5 DAIprocs: 54) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_2] 2021-08-20 01:06:32,359 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:06:32,364 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:06:32,366 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:06:33,262 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 58.45046 seconds. 2021-08-20 01:06:33,274 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:06:33,278 C: 27% D:988.2GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:06:33,363 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 86 iterations: 86 2021-08-20 01:06:33,368 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09127 seconds. 2021-08-20 01:06:33,371 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09681 seconds. 2021-08-20 01:06:33,618 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 2 9 and Completed 7 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:06:33,680 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:06:33,682 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:06:33,685 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:06:33,751 C: 37% D:987.8GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:06:34,573 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 59.07556 seconds. 2021-08-20 01:06:34,584 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:06:34,587 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:06:34,649 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 92 iterations: 92 2021-08-20 01:06:34,655 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07330 seconds. 2021-08-20 01:06:34,658 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07930 seconds. 2021-08-20 01:06:35,021 C: 32% D:987.2GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:07:10,099 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:07:10,105 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:07:10,107 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:07:10,909 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 35.88800 seconds. 2021-08-20 01:07:10,921 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:07:10,923 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:07:10,990 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:07:10,996 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07218 seconds. 2021-08-20 01:07:10,998 C: 30% D:987.2GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07746 seconds. 2021-08-20 01:07:11,246 C: 29% D:987.2GB M:236.5GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 4 11 and Completed 9 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:07:11,401 C: 29% D:987.2GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:07:14,200 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:07:14,208 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:07:14,210 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:07:15,067 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 19.3GB, since last ping: 10.6MB/s. CPU memory usage: 780.6MB, max: 894.3MB CPU: 179% Procs: 5 . GPU memory usage: 149.9MB, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 40.7kB/s Size: 3.1MB) (Connections: 58 Fds: 274 WinHandles: 0 Threads: 13 Maps: 3995 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 10% Wait: 7% DAIActiveprocs: 5 DAIprocs: 55) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_5] 2021-08-20 01:07:15,174 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 41.42318 seconds. 2021-08-20 01:07:15,185 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:07:15,187 C: 19% D:987.2GB M:236.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:07:15,255 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:07:15,265 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07342 seconds. 2021-08-20 01:07:15,268 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07867 seconds. 2021-08-20 01:07:15,621 C: 40% D:988.6GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:07:57,192 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:07:57,200 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:07:57,202 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:07:58,032 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 42.41045 seconds. 2021-08-20 01:07:58,044 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:07:58,046 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:07:58,112 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:07:58,118 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07113 seconds. 2021-08-20 01:07:58,120 C: 37% D:988.9GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07667 seconds. 2021-08-20 01:08:19,119 C: 34% D:985.1GB M:236.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 20.8GB, since last ping: 1.6MB/s. CPU memory usage: 566.5MB, max: 894.3MB CPU: 59% Procs: 4 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/4194304 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 2.6kB/s Size: 3.1MB) (Connections: 46 Fds: 210 WinHandles: 0 Threads: 10 Maps: 3189 WinOpenFiles: 0) (System-Wide CPU: User: 22% Nice: 0% System: 8% Wait: 1% DAIActiveprocs: 5 DAIprocs: 52) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train 1 (1) (True) [1000000, 1000000, 1000000, 1000000, 1000000, 1000000] [0.0, 0.0, 0.0, 0.0, 0.0, 0.0]] 2021-08-20 01:08:44,436 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:08:44,443 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:08:44,444 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:08:45,404 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 94.00369 seconds. 2021-08-20 01:08:45,416 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:08:45,418 C: 20% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:08:45,485 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 104 iterations: 104 2021-08-20 01:08:45,491 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07196 seconds. 2021-08-20 01:08:45,493 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07689 seconds. 2021-08-20 01:08:45,666 C: 34% D:984.1GB M:239.8GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:08:49,742 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 105, fit model time: 105 2021-08-20 01:08:49,750 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 10, total model time: 106.32, fit model time: 106.31 2021-08-20 01:08:49,752 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.8311, fit model time: 1.8303 2021-08-20 01:08:49,754 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 1.6775, fit model time: 1.6768 2021-08-20 01:08:49,757 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 80.02, fit model time: 80.019 2021-08-20 01:08:49,759 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 10, total model time: 79.873, fit model time: 79.873 2021-08-20 01:08:49,761 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 86, model transformed features: 10, total model time: 58.805, fit model time: 58.804 2021-08-20 01:08:49,763 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 92, model transformed features: 10, total model time: 59.376, fit model time: 59.375 2021-08-20 01:08:49,765 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 100, model transformed features: 10, total model time: 36.178, fit model time: 36.177 2021-08-20 01:08:49,768 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 41.705, fit model time: 41.704 2021-08-20 01:08:49,770 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 100, model transformed features: 10, total model time: 42.707, fit model time: 42.706 2021-08-20 01:08:49,772 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 104, model transformed features: 10, total model time: 94.3, fit model time: 94.299 2021-08-20 01:08:50,160 C: 18% D:984.7GB M:240.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.8655 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:08:50,759 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.8728 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:08:51,506 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Munge time: 1.6722 s, Train time: 378.7408 s, Score time: 4.2395 s 2021-08-20 01:08:51,580 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 2/2 base individual models out of 12 total models across folds, out of population with 2 individuals). 2021-08-20 01:08:51,594 C: 13% D:984.6GB M:239.9GB NODE:LOCAL1 7646 INFO | Completed 132 munging tasks out of 132 total tasks (including identity) for 2 indivs and 6 folds 2021-08-20 01:08:51,836 C: 32% D:985.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:08:51,981 C: 32% D:985.4GB M:240.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:22,692 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:22,698 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:09:22,700 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:09:23,152 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 31.17111 seconds. 2021-08-20 01:09:23,164 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:23,167 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:23,232 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:09:23,239 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07118 seconds. 2021-08-20 01:09:23,241 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.07677 seconds. 2021-08-20 01:09:23,489 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 2 3 and Completed 1 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:09:23,617 C: 31% D:983.1GB M:237.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:23,695 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:23,700 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:09:23,702 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:09:24,198 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 32.36196 seconds. 2021-08-20 01:09:24,211 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:09:24,213 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:09:24,279 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:09:24,285 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.07105 seconds. 2021-08-20 01:09:24,287 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.07651 seconds. 2021-08-20 01:09:24,641 C: 27% D:983.1GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:09:25,246 C: 28% D:983.1GB M:237.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 27.6GB, since last ping: 9.3MB/s. CPU memory usage: 624.9MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 31 (Disk: Read: 0B/s Write: 2.3kB/s Size: 3.0MB) (Connections: 58 Fds: 267 WinHandles: 0 Threads: 13 Maps: 3994 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 12% Wait: 1% DAIActiveprocs: 5 DAIprocs: 48) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_0_fold_4] 2021-08-20 01:09:28,300 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:28,309 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:09:28,311 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:09:28,892 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 5.27049 seconds. 2021-08-20 01:09:28,907 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:28,909 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:28,983 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:09:28,991 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.08099 seconds. 2021-08-20 01:09:28,994 C: 17% D:983.1GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08766 seconds. 2021-08-20 01:09:29,383 C: 33% D:983.0GB M:236.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:43,264 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:43,270 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:09:43,271 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:09:43,738 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 19.09610 seconds. 2021-08-20 01:09:43,748 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:09:43,751 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:09:43,826 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:09:43,835 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.08282 seconds. 2021-08-20 01:09:43,838 C: 24% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.08878 seconds. 2021-08-20 01:09:44,266 C: 18% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 5 6 and Completed 4 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:09:44,402 C: 18% D:978.5GB M:237.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:09:49,692 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:09:49,698 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:09:49,700 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:09:50,187 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 20.80432 seconds. 2021-08-20 01:09:50,199 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:50,202 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:50,274 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:09:50,281 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07834 seconds. 2021-08-20 01:09:50,283 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08393 seconds. 2021-08-20 01:09:50,622 C: 12% D:978.4GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:09:57,296 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:09:57,305 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:09:57,307 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:09:57,857 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 13.45468 seconds. 2021-08-20 01:09:57,868 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:09:57,871 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:09:57,940 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:09:57,947 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07518 seconds. 2021-08-20 01:09:57,949 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08105 seconds. 2021-08-20 01:09:58,198 C: 18% D:975.0GB M:235.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 1 8 and Completed 6 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:09:58,340 C: 33% D:974.9GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:02,525 C: 17% D:974.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:02,533 C: 17% D:974.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:10:02,535 C: 17% D:974.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:03,725 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 13.10252 seconds. 2021-08-20 01:10:03,736 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:10:03,739 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:10:03,808 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:10:03,814 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07515 seconds. 2021-08-20 01:10:03,816 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07997 seconds. 2021-08-20 01:10:04,217 C: 31% D:974.9GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:12,542 C: 14% D:974.5GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:12,551 C: 14% D:974.5GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:10:12,553 C: 14% D:974.5GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:13,574 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 15.23350 seconds. 2021-08-20 01:10:13,588 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:13,592 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:13,669 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 90 iterations: 90 2021-08-20 01:10:13,675 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08308 seconds. 2021-08-20 01:10:13,677 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08902 seconds. 2021-08-20 01:10:13,923 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 1 fold_id= 3 10 and Completed 8 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:10:14,092 C: 28% D:975.8GB M:233.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:10:14,853 C: 16% D:975.3GB M:233.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:14,862 C: 16% D:975.3GB M:233.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:10:14,864 C: 16% D:975.3GB M:233.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:16,092 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 11.87453 seconds. 2021-08-20 01:10:16,101 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:16,104 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:16,168 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:10:16,175 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07141 seconds. 2021-08-20 01:10:16,178 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07614 seconds. 2021-08-20 01:10:16,576 C: 29% D:975.2GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:20,095 C: 18% D:974.9GB M:235.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:20,102 C: 18% D:974.9GB M:235.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:10:20,104 C: 18% D:974.9GB M:235.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:21,405 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 7.31319 seconds. 2021-08-20 01:10:21,417 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:10:21,419 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:10:21,486 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 127 iterations: 127 2021-08-20 01:10:21,493 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07294 seconds. 2021-08-20 01:10:21,495 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.07821 seconds. 2021-08-20 01:10:21,880 C: 37% D:975.2GB M:235.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:10:27,351 C: 26% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:27,356 C: 26% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:10:27,358 C: 26% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:28,383 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 11.80848 seconds. 2021-08-20 01:10:28,395 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:28,398 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:28,477 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:10:28,484 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08562 seconds. 2021-08-20 01:10:28,487 C: 37% D:975.6GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09148 seconds. 2021-08-20 01:10:32,390 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:10:32,395 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:10:32,397 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:32,875 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 36.2GB, since last ping: 10.2MB/s. CPU memory usage: 609.2MB, max: 894.3MB CPU: 399% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 15 (Disk: Read: 0B/s Write: 46.6kB/s Size: 3.1MB) (Connections: 46 Fds: 215 WinHandles: 0 Threads: 10 Maps: 3196 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 8% Wait: 6% DAIActiveprocs: 3 DAIprocs: 45) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:parameter_tuningParameter_&_feature_tuning_(iteration_5_batch_6-7_for_pop_size:_8)_train-training_xgb_indiv_1_fold_5] 2021-08-20 01:10:33,297 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 11.41764 seconds. 2021-08-20 01:10:33,309 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:10:33,311 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:10:33,379 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:10:33,385 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07379 seconds. 2021-08-20 01:10:33,388 C: 24% D:975.6GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07904 seconds. 2021-08-20 01:10:33,662 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | Completed 12 training tasks out of 12 total tasks for 2 indivs and 6 folds 2021-08-20 01:10:38,244 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 31.447, fit model time: 31.446 2021-08-20 01:10:38,250 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 32.658, fit model time: 32.657 2021-08-20 01:10:38,252 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 14, total model time: 5.5744, fit model time: 5.5733 2021-08-20 01:10:38,254 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 19.579, fit model time: 19.42 2021-08-20 01:10:38,256 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 21.111, fit model time: 21.11 2021-08-20 01:10:38,258 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 13.742, fit model time: 13.741 2021-08-20 01:10:38,260 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 105, model transformed features: 15, total model time: 13.406, fit model time: 13.405 2021-08-20 01:10:38,262 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 90, model transformed features: 15, total model time: 15.548, fit model time: 15.547 2021-08-20 01:10:38,263 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 124, model transformed features: 15, total model time: 12.186, fit model time: 12.18 2021-08-20 01:10:38,265 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 127, model transformed features: 15, total model time: 7.6344, fit model time: 7.6334 2021-08-20 01:10:38,272 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 108, model transformed features: 15, total model time: 12.134, fit model time: 12.132 2021-08-20 01:10:38,274 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 97, model transformed features: 15, total model time: 11.708, fit model time: 11.707 2021-08-20 01:10:38,653 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:10:38,701 C: 17% D:975.6GB M:237.1GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6921 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:10:39,361 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Munge time: 0.0349 s, Train time: 102.0641 s, Score time: 4.7527 s 2021-08-20 01:10:39,512 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:10:39,979 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:10:40,023 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 3.98 % 2021-08-20 01:10:40,057 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Scored 27/598 models on 99 features. Last Scored [LIGHTGBM] 2021-08-20 01:10:40,064 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:10:40,067 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638488 +/- 0.04910973 [Tournament: 1.638488 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:10:40,069 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:10:40,070 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.692052 +/- 0.04037833 [Tournament: 1.692052 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:10:40,073 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638488 RMSE 2021-08-20 01:10:40,079 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:10:40,085 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:10:40,087 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:10:40,089 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:10:40,091 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:10:40,094 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:10:40,096 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:10:40,098 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:10:40,100 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:10:40,103 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:10:40,105 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:10:40,108 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:10:40,111 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Tuned 36/48 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [LIGHTGBM] 2021-08-20 01:10:40,114 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:10:40,117 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:10:40,119 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 6 2021-08-20 01:10:40,122 C: 29% D:975.6GB M:237.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:10:40,457 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:10:41,254 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:10:41,272 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1037348897', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (0, 0, 10) 2021-08-20 01:10:41,276 C: 28% D:975.6GB M:238.4GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:10:41,554 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:10:41,627 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:10:42,360 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:42,362 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:10:42,365 C: 24% D:975.6GB M:238.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:43,450 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.89594 seconds. 2021-08-20 01:10:43,463 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:10:43,466 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:10:43,502 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:43,505 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:10:43,507 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:43,585 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:10:43,595 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.12696 seconds. 2021-08-20 01:10:43,601 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.13528 seconds. 2021-08-20 01:10:44,077 C: 25% D:975.6GB M:237.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:10:44,605 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.97544 seconds. 2021-08-20 01:10:44,618 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:10:44,621 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:10:44,684 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 01:10:44,690 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.06971 seconds. 2021-08-20 01:10:44,693 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.07491 seconds. 2021-08-20 01:10:45,066 C: 34% D:975.6GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:10:49,399 C: 23% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:49,407 C: 23% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:10:49,408 C: 23% D:975.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:50,570 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 6.48860 seconds. 2021-08-20 01:10:50,585 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:10:50,587 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:10:50,674 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 123 iterations: 123 2021-08-20 01:10:50,676 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07757 seconds. 2021-08-20 01:10:50,678 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08325 seconds. 2021-08-20 01:10:51,128 C: 33% D:975.6GB M:234.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:10:54,575 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:10:54,581 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:10:54,583 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:10:55,498 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 10.43178 seconds. 2021-08-20 01:10:55,509 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:10:55,511 C: 47% D:974.1GB M:233.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:10:55,587 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:10:55,595 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.08223 seconds. 2021-08-20 01:10:55,598 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.08877 seconds. 2021-08-20 01:10:55,908 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 5 6 and Completed 4 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:10:56,053 C: 72% D:974.0GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:11:00,764 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:00,771 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:11:00,774 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:01,468 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:11:01,474 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:11:01,479 C: 63% D:975.1GB M:232.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:01,805 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 10.67199 seconds. 2021-08-20 01:11:01,835 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:11:01,843 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:11:01,962 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 99 iterations: 99 2021-08-20 01:11:01,996 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.14944 seconds. 2021-08-20 01:11:02,002 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.17180 seconds. 2021-08-20 01:11:02,657 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 6.60406 seconds. 2021-08-20 01:11:02,669 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:11:02,673 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:11:02,750 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:11:02,759 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.08406 seconds. 2021-08-20 01:11:02,763 C: 75% D:975.1GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.09275 seconds. 2021-08-20 01:11:02,930 C: 79% D:975.1GB M:231.5GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:11:05,589 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 2.287, fit model time: 2.2861 2021-08-20 01:11:05,597 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 10, total model time: 3.2728, fit model time: 3.2719 2021-08-20 01:11:05,599 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 123, model transformed features: 10, total model time: 6.8034, fit model time: 6.8024 2021-08-20 01:11:05,601 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 10, total model time: 10.781, fit model time: 10.78 2021-08-20 01:11:05,603 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 99, model transformed features: 10, total model time: 11.105, fit model time: 11.104 2021-08-20 01:11:05,605 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 10, total model time: 6.9094, fit model time: 6.9085 2021-08-20 01:11:05,975 C: 72% D:977.3GB M:232.8GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.8349 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:11:06,736 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | Munge time: 0.8339 s, Train time: 21.6534 s, Score time: 2.8129 s 2021-08-20 01:11:06,802 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/1 base individual models out of 6 total models across folds, out of population with 1 individuals). 2021-08-20 01:11:06,813 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | Completed 66 munging tasks out of 66 total tasks (including identity) for 1 indivs and 6 folds 2021-08-20 01:11:07,090 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:11:07,190 C: 66% D:977.2GB M:232.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:11,081 C: 65% D:977.0GB M:232.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:11,088 C: 65% D:977.0GB M:232.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:11:11,089 C: 65% D:977.0GB M:232.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:11:12,672 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 5.58264 seconds. 2021-08-20 01:11:12,685 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:11:12,687 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:11:12,763 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:11:12,772 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.08326 seconds. 2021-08-20 01:11:12,774 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.08986 seconds. 2021-08-20 01:11:13,225 C: 78% D:976.9GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:16,109 C: 66% D:976.7GB M:229.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:16,117 C: 66% D:976.7GB M:229.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:11:16,119 C: 66% D:976.7GB M:229.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:11:17,554 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 10.36283 seconds. 2021-08-20 01:11:17,576 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:17,579 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:17,656 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 128 iterations: 128 2021-08-20 01:11:17,664 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.08381 seconds. 2021-08-20 01:11:17,670 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.09196 seconds. 2021-08-20 01:11:17,958 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 0 fold_id= 3 4 and Completed 2 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:11:18,159 C: 82% D:976.6GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:11:21,615 C: 66% D:976.4GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:21,626 C: 66% D:976.4GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:11:21,631 C: 66% D:976.4GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:11:23,752 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 10.52704 seconds. 2021-08-20 01:11:23,767 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:23,771 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:23,855 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 129 iterations: 129 2021-08-20 01:11:23,862 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.09110 seconds. 2021-08-20 01:11:23,865 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.09821 seconds. 2021-08-20 01:11:24,044 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:24,047 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:11:24,051 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:11:24,465 C: 88% D:976.7GB M:235.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:24,906 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:24,915 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:11:24,917 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:11:25,619 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 7.45928 seconds. 2021-08-20 01:11:25,636 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:11:25,639 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:11:25,754 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:11:25,785 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.14438 seconds. 2021-08-20 01:11:25,788 C: 86% D:976.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.15143 seconds. 2021-08-20 01:11:26,068 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.60242 seconds. 2021-08-20 01:11:26,086 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:26,090 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:26,188 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 96 iterations: 96 2021-08-20 01:11:26,239 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.14487 seconds. 2021-08-20 01:11:26,245 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.15774 seconds. 2021-08-20 01:11:26,340 C: 85% D:977.6GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:11:27,200 C: 74% D:977.5GB M:234.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:11:27,209 C: 74% D:977.5GB M:234.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:11:27,212 C: 74% D:977.5GB M:234.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:11:28,381 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 2.03980 seconds. 2021-08-20 01:11:28,398 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:11:28,402 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:11:28,497 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 108 iterations: 108 2021-08-20 01:11:28,522 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.11991 seconds. 2021-08-20 01:11:28,526 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.12751 seconds. 2021-08-20 01:11:28,741 C: 80% D:977.4GB M:234.4GB NODE:LOCAL1 7646 INFO | Completed 6 training tasks out of 6 total tasks for 1 indivs and 6 folds 2021-08-20 01:11:32,694 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 139, model transformed features: 14, total model time: 5.9484, fit model time: 5.947 2021-08-20 01:11:32,700 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 128, model transformed features: 14, total model time: 10.685, fit model time: 10.684 2021-08-20 01:11:32,702 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 129, model transformed features: 14, total model time: 10.857, fit model time: 10.856 2021-08-20 01:11:32,703 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 124, model transformed features: 14, total model time: 7.8993, fit model time: 7.8981 2021-08-20 01:11:32,705 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 96, model transformed features: 14, total model time: 2.0476, fit model time: 2.0467 2021-08-20 01:11:32,707 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 108, model transformed features: 14, total model time: 2.4551, fit model time: 2.4541 2021-08-20 01:11:33,186 C: 72% D:977.1GB M:233.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6832 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:11:34,062 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Munge time: 0.0349 s, Train time: 22.7540 s, Score time: 3.3203 s 2021-08-20 01:11:34,214 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:11:34,588 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:11:34,621 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Experiment Progress: 4.13 % 2021-08-20 01:11:34,645 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Scored 28/598 models on 113 features. Last Scored [LIGHTGBM] 2021-08-20 01:11:34,652 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:11:34,655 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:34,657 C: 76% D:977.0GB M:232.7GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.683212 +/- 0.06572724 [Tournament: 1.683212 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:11:35,261 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:11:35,264 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:11:35,273 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:11:35,276 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:11:35,280 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:11:35,286 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:11:35,290 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:11:35,294 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:11:35,296 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:11:35,298 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:11:35,301 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:11:35,304 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:11:35,309 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:11:35,314 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Tuned 42/42 Parameter & feature tuning models. Tuned [LIGHTGBM] Tuning [] 2021-08-20 01:11:35,522 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:11:35,689 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Picking the fastest model with a score within 0.002455487 (z-score <= 0.050) of the best score 2021-08-20 01:11:35,748 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Model and feature tuning leaderboard (scorer=RMSE): 2021-08-20 01:11:35,751 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+-----------------------------------------------------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:11:35,754 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:11:35,756 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | |-------------+--------------+-----------------------------------------------------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------| 2021-08-20 01:11:35,758 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 0 | PASSED | TARGET_TUNING | LightGBMModel | 1.63852 | 0.0491097 | 11.5146 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.63852 | 1.63852 | 0.0491097 | 1.63852 | 0.0928991 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 1 | 1 | 1565.33 | 0 | * | + | 2021-08-20 01:11:35,760 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.64367 | 0.0614287 | 123.947 | 300 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0.001 | 0.3 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.64367 | 1.64367 | 0.0614287 | 1.64367 | 1 | 1 | 13 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.996864 | 0.996864 | 88 | 0.104973 | | | 2021-08-20 01:11:35,762 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 3 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | 1.66976 | 0.0417155 | 12.762 | 117 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 50 | True | | | [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.66976 | 1.66976 | 0.0417155 | 1.66976 | 0.102963 | 0.39 | 10 | 100 | 13 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.981289 | 0.981289 | 1233.29 | 0.636189 | | | 2021-08-20 01:11:35,763 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 8 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:8,num_as_cat:False | LightGBMModel | 1.68321 | 0.0657272 | 39.885 | 121 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | FeatureModelTuning | 1.68321 | 1.68321 | 0.0657272 | 1.68321 | 0.32179 | 0.403333 | 11 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.973446 | 0.973446 | 1403 | 0.910115 | | | 2021-08-20 01:11:35,765 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 4 | PASSED | RANDOM | LightGBMModel | 1.69092 | 0.0541736 | 6.89313 | 140 | 16 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0 | 0.7 | 0.4 | 10 | 1 | 1 | 10 | 1 | 0.001 | 0 | 200000 | | True | mse | mae | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.69092 | 1.69092 | 0.0541736 | 1.69092 | 0.0556135 | 0.466667 | 13 | 100 | 16 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.96901 | 0.96901 | 41.0667 | 1.06702 | | | 2021-08-20 01:11:35,767 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 7 | PASSED | RANDOM | LightGBMModel | 1.69205 | 0.0403783 | 72.6053 | 109 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 1 | 0.9 | 0.6 | 10 | 0 | 0.0001 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 1.69205 | 1.69205 | 0.0403783 | 1.69205 | 0.585776 | 0.363333 | 13 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.968361 | 0.968361 | 1263.86 | 1.09011 | | | 2021-08-20 01:11:35,769 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | | 2 | PASSED | DefaultIndiv: do_te:True,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | 2.08023 | 0.0352351 | 10.8259 | 93 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 50 | True | | | [1, 1, -1, 1, 0, 1, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | FeatureModelTuning | 2.08023 | 2.08023 | 0.0352351 | 2.08023 | 0.0873429 | 0.31 | 10 | 100 | 13 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.787662 | 0.787662 | 980.306 | 8.99438 | | | 2021-08-20 01:11:35,771 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | +-------------+--------------+-----------------------------------------------------------------+--------------------+----------+-------------+------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+--------------------+---------------------+---------------+------------------+--------------------------+------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------+-------------------------+--------------+-----------+-----------+--------+ 2021-08-20 01:11:35,849 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Best parameters: 2021-08-20 01:11:35,852 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_classes: 1 2021-08-20 01:11:35,855 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_class: 1 2021-08-20 01:11:35,858 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | booster: lightgbm 2021-08-20 01:11:35,860 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | seed: 1037348886 2021-08-20 01:11:35,862 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | disable_gpus: False 2021-08-20 01:11:35,863 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | n_gpus: 1 2021-08-20 01:11:35,865 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | score_f_name: RMSE 2021-08-20 01:11:35,867 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | label_counts: None 2021-08-20 01:11:35,869 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | _build_info: {'commit': '4d0fa39', 'version': '1.10.0'} 2021-08-20 01:11:35,871 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | model_class_name: LightGBMModel 2021-08-20 01:11:35,873 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_id: 0 2021-08-20 01:11:35,875 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | n_jobs: 4 2021-08-20 01:11:35,877 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | random_state: 1037348886 2021-08-20 01:11:35,879 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | pred_gap: None 2021-08-20 01:11:35,881 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | pred_periods: None 2021-08-20 01:11:35,882 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ufapt: None 2021-08-20 01:11:35,884 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | boosting_type: gbdt 2021-08-20 01:11:35,886 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | enable_early_stopping_rounds: True 2021-08-20 01:11:35,888 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | learning_rate: 0.049999999999999996 2021-08-20 01:11:35,890 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | grow_policy: depthwise 2021-08-20 01:11:35,892 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_depth: 10 2021-08-20 01:11:35,894 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_leaves: 1024 2021-08-20 01:11:35,896 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_bin: 64 2021-08-20 01:11:35,897 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | scale_pos_weight: 1.0 2021-08-20 01:11:35,899 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | max_delta_step: 0.0 2021-08-20 01:11:35,901 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gamma: 0.0 2021-08-20 01:11:35,903 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | colsample_bytree: 0.7999999999999999 2021-08-20 01:11:35,905 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | subsample: 0.7000000000000001 2021-08-20 01:11:35,906 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | subsample_freq: 1 2021-08-20 01:11:35,908 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | reg_lambda: 0.0 2021-08-20 01:11:35,910 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | reg_alpha: 0.0 2021-08-20 01:11:35,912 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_child_samples: 1 2021-08-20 01:11:35,913 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_data_in_bin: 1 2021-08-20 01:11:35,915 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_child_weight: 0.001 2021-08-20 01:11:35,917 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | min_split_gain: 0.0 2021-08-20 01:11:35,919 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | subsample_for_bin: 200000 2021-08-20 01:11:35,921 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | class_weight: None 2021-08-20 01:11:35,922 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotonicity_constraints: True 2021-08-20 01:11:35,924 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | objective: mse 2021-08-20 01:11:35,926 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | eval_metric: rmse 2021-08-20 01:11:35,928 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | early_stopping_rounds: 30 2021-08-20 01:11:35,930 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | n_estimators: 300 2021-08-20 01:11:35,932 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | importance_type: gain 2021-08-20 01:11:35,933 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_leaves: 1024 2021-08-20 01:11:35,935 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | feature_fraction_seed: 1037348887 2021-08-20 01:11:35,937 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | bagging_seed: 1037348888 2021-08-20 01:11:35,939 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | num_threads: 4 2021-08-20 01:11:35,941 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | device_type: cpu 2021-08-20 01:11:35,943 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_device_id: 0 2021-08-20 01:11:35,949 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_platform_id: 0 2021-08-20 01:11:35,951 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | gpu_use_dp: False 2021-08-20 01:11:35,953 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | verbose: -1 2021-08-20 01:11:35,956 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | lossguide: False 2021-08-20 01:11:35,958 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | silent: True 2021-08-20 01:11:35,960 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | accuracy: 7 2021-08-20 01:11:35,962 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | time_tolerance: 2 2021-08-20 01:11:35,964 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | interpretability: 8 2021-08-20 01:11:35,966 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ensemble_level: 1 2021-08-20 01:11:35,968 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | train_shape: (1000, 11) 2021-08-20 01:11:35,970 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | valid_shape: None 2021-08-20 01:11:35,973 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | model_origin: TARGET_TUNING 2021-08-20 01:11:35,975 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | resumed_experiment_id: 2021-08-20 01:11:35,977 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | str_uuid: ret_b97a3cbb-f99d-414f-aa44-cddc62776504 2021-08-20 01:11:35,980 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | experiment_description: buvobamu 2021-08-20 01:11:35,982 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | train_dataset_name: Friedman1-results.csv 2021-08-20 01:11:35,985 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | valid_data_name: [Valid] 2021-08-20 01:11:35,987 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | test_data_name: None 2021-08-20 01:11:35,989 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | outer_trial: (1, 2) 2021-08-20 01:11:35,992 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ngenes: 11 2021-08-20 01:11:35,994 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | ngenes_max: 100 2021-08-20 01:11:35,996 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | uses_gpu: True 2021-08-20 01:11:35,998 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | early_stopping_threshold: None 2021-08-20 01:11:36,001 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | early_stopping_limit: None 2021-08-20 01:11:36,003 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotone_constraints: [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] 2021-08-20 01:11:36,005 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotone_penalty: 0.0 2021-08-20 01:11:36,009 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | categorical_feature: 2021-08-20 01:11:36,011 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | monotone_constraints_method: intermediate 2021-08-20 01:11:36,013 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best job_order: 0 2021-08-20 01:11:36,015 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best_iterations: 135 2021-08-20 01:11:36,017 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best_ngenes: 11 2021-08-20 01:11:36,019 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | best_nfeatures: 17 2021-08-20 01:11:36,021 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Selected population via model tournament mode: [('LightGBMModel', 1.6385166645050049), ('LightGBMModel', 1.6385166645050049), ('LightGBMModel', 1.6385166645050049), ('LightGBMModel', 1.6436718702316284), ('LightGBMModel', 1.669759750366211), ('LightGBMModel', 2.080228328704834), ('LightGBMModel', 1.6920517683029175), ('LightGBMModel', 1.6909176111221313), ('LightGBMModel', 1.683212161064148)] 2021-08-20 01:11:36,031 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Model and feature tuning scores (RMSE, less is better): 2021-08-20 01:11:36,033 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,036 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,038 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,040 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:11:36,042 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:11:36,044 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.683212 +/- 0.06572724 [Tournament: 1.683212 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:11:36,046 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.690918 +/- 0.05417363 [Tournament: 1.690918 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:11:36,048 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 7 : 1.692052 +/- 0.04037833 [Tournament: 1.692052 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:11:36,050 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Individual 8 : 2.080228 +/- 0.03523514 [Tournament: 2.080228 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:11:36,052 C: 65% D:976.9GB M:232.5GB NODE:LOCAL1 7646 INFO | Applying nfeatures_max and ngenes_max limits to tuning population 2021-08-20 01:11:37,886 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Parameter tuning: end : Duration: 634.5521 s 2021-08-20 01:11:38,399 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Prepare Feature Evolution 2021-08-20 01:11:38,407 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Feature evolution has 0 brain cached individuals out of 8 individuals 2021-08-20 01:11:38,411 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Making 1 new individuals during preparation for evolution 2021-08-20 01:11:38,604 C: 76% D:976.7GB M:232.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 45.1GB, since last ping: 48.7MB/s. CPU memory usage: 481.6MB, max: 894.3MB CPU: 79% Procs: 3 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/3145728 (OpenFilesUser: 0) PSThreads: 12 (Disk: Read: 0B/s Write: 170.6kB/s Size: 3.1MB) (Connections: 34 Fds: 131 WinHandles: 0 Threads: 7 Maps: 2373 WinOpenFiles: 0) (System-Wide CPU: User: 64% Nice: 0% System: 10% Wait: 2% DAIActiveprocs: 22 DAIprocs: 61) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:Prepare_Feature_Evolutionfeature_selection_(FS)] 2021-08-20 01:11:38,922 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:11:38,928 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Model params_base (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:11:38,930 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Model params (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:11:39,249 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Pre-pruning 1 gene(s) from 12 active base genes 2021-08-20 01:11:39,262 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Starting search for statistically relevant features (FS scheme) 2021-08-20 01:11:39,270 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | FS Permute population of size 1 has 2 unique transformations that include: ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:11:39,278 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Transforming FS train 2021-08-20 01:11:39,286 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Using 2 parallel workers (1 parent workers) for fit_transform. 2021-08-20 01:11:39,706 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Submitted 2 and Completed 2 non-identity feature engineering tasks out of 12 total tasks (including 10 identity) 2021-08-20 01:11:39,714 C: 76% D:976.3GB M:232.4GB NODE:LOCAL1 7646 INFO | Transforming FS valid 2021-08-20 01:11:40,136 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 INFO | Submitted 2 and Completed 2 non-identity feature engineering tasks out of 12 total tasks (including 10 identity) 2021-08-20 01:11:40,597 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 INFO | 10 features created during FS Permute 2021-08-20 01:11:41,029 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:11:41,031 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 DATA | Model params_base (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:11:41,034 C: 77% D:976.2GB M:232.1GB NODE:LOCAL1 7646 DATA | Model params (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:11:41,716 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:11:41,722 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Model params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:11:41,724 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Model params: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:11:41,725 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 INFO | FS: fold_id=0/2 2021-08-20 01:11:41,906 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) start. 2021-08-20 01:11:42,595 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:42,598 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41031', 'X_1': '0.33523', 'X_3': '0.56239', 'X_4': '0.34860'} 2021-08-20 01:11:42,600 C: 70% D:976.1GB M:232.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:43,626 C: 74% D:976.0GB M:232.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) end. Took 1.71978 seconds. 2021-08-20 01:11:48,103 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) start. 2021-08-20 01:11:48,109 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) start. 2021-08-20 01:11:48,260 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:11:48,266 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) end. Took 0.16064 seconds. 2021-08-20 01:11:48,268 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) end. Took 0.16987 seconds. 2021-08-20 01:11:48,388 C: 39% D:975.6GB M:231.1GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:11:49,912 C: 42% D:975.5GB M:231.4GB NODE:LOCAL1 7646 INFO | FS: fold_id=1/2 2021-08-20 01:11:50,101 C: 42% D:975.5GB M:231.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) start. 2021-08-20 01:11:55,012 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:55,017 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41275', 'X_1': '0.37985', 'X_3': '0.58310', 'X_4': '0.32120'} 2021-08-20 01:11:55,019 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:11:55,844 C: 59% D:975.6GB M:229.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) end. Took 5.74852 seconds. 2021-08-20 01:11:56,211 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) start. 2021-08-20 01:11:56,219 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) start. 2021-08-20 01:11:56,411 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:11:56,418 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) end. Took 0.20352 seconds. 2021-08-20 01:11:56,422 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) end. Took 0.21382 seconds. 2021-08-20 01:11:56,548 C: 70% D:975.1GB M:229.2GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:11:58,568 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 INFO | FS: fold_id=2/2 2021-08-20 01:11:58,774 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) start. 2021-08-20 01:11:59,150 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:11:59,153 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43118', 'X_1': '0.36603', 'X_3': '0.55504', 'X_4': '0.31388'} 2021-08-20 01:11:59,157 C: 82% D:974.2GB M:230.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:00,129 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (444, 10) end. Took 1.35754 seconds. 2021-08-20 01:12:00,423 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) start. 2021-08-20 01:12:00,427 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) start. 2021-08-20 01:12:00,667 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:00,676 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (222, 10) model predict (222, 10) end. Took 0.24810 seconds. 2021-08-20 01:12:00,680 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (222, 10) end. Took 0.26162 seconds. 2021-08-20 01:12:00,839 C: 80% D:973.9GB M:229.2GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:03,032 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:12:03,038 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params_base (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:12:03,039 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params (based upon original train shape, possible changes if FS on sample): {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:12:03,041 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | Using model LIGHTGBM for FS 2021-08-20 01:12:03,043 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params_base: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30} 2021-08-20 01:12:03,045 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Model params: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, 'model_class_name': 'LightGBMModel', 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'n_estimators': 135, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': 'unused', 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'best_iterations': 135, 'best_learning_rate': 0.049999999999999996, 'task': , 'experiment_id': '59939c96-0150-11ec-a7e1-0242c0a8fe02', 'early_stopping_rounds': 30, 'n_jobs': 4} 2021-08-20 01:12:03,048 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | FS: fold_id=0/2 2021-08-20 01:12:03,221 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) start. 2021-08-20 01:12:03,521 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:03,523 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43238', 'X_1': '0.33524', 'X_3': '0.58360', 'X_4': '0.27867'} 2021-08-20 01:12:03,526 C: 79% D:973.6GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:04,514 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) end. Took 1.29405 seconds. 2021-08-20 01:12:04,734 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) start. 2021-08-20 01:12:04,738 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) start. 2021-08-20 01:12:04,920 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:04,927 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) end. Took 0.18832 seconds. 2021-08-20 01:12:04,929 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) end. Took 0.19766 seconds. 2021-08-20 01:12:05,062 C: 68% D:973.5GB M:235.1GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:06,976 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 INFO | FS: fold_id=1/2 2021-08-20 01:12:07,178 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) start. 2021-08-20 01:12:07,456 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:07,459 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43100', 'X_1': '0.47994', 'X_3': '0.53554', 'X_4': '0.35813'} 2021-08-20 01:12:07,463 C: 56% D:973.3GB M:235.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:08,390 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) end. Took 1.21635 seconds. 2021-08-20 01:12:08,653 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) start. 2021-08-20 01:12:08,656 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) start. 2021-08-20 01:12:08,869 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:08,874 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) end. Took 0.21723 seconds. 2021-08-20 01:12:08,876 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) end. Took 0.22513 seconds. 2021-08-20 01:12:08,986 C: 64% D:973.3GB M:234.9GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:11,008 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 INFO | FS: fold_id=2/2 2021-08-20 01:12:11,166 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) start. 2021-08-20 01:12:11,475 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:11,477 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.46649', 'X_1': '0.35158', 'X_3': '0.60755', 'X_4': '0.32738'} 2021-08-20 01:12:11,479 C: 58% D:973.1GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:12,200 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (222, 10) end. Took 1.03747 seconds. 2021-08-20 01:12:12,406 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) start. 2021-08-20 01:12:12,410 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) start. 2021-08-20 01:12:12,556 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:12:12,561 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (111, 10) model predict (111, 10) end. Took 0.15135 seconds. 2021-08-20 01:12:12,563 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (111, 10) end. Took 0.16012 seconds. 2021-08-20 01:12:12,682 C: 37% D:973.0GB M:234.0GB NODE:LOCAL1 7646 INFO | FS predict shuffle max_workers=10 step=1 n_jobs/worker=2 n_jobs=2 n_gpus=0 2021-08-20 01:12:14,407 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Pruning 5 features(s) out of 10 features(s) 2021-08-20 01:12:14,413 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Removed features: ['37_X_9', '5_X_5', '6_X_6', '7_X_7', '8_X_8'] 2021-08-20 01:12:14,415 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 DATA | Selected features: ['0_X_0', '1_X_1', '2_X_2', '3_X_3', '4_X_4'] 2021-08-20 01:12:14,604 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | FS strategy run finished in 36.18509 s 2021-08-20 01:12:14,965 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Feature Evolution starting with population of 8 scored individuals (scores=['1.638517', '1.638517', '1.638517', '1.643672', '1.66976', '1.683212', '1.690918']) 2021-08-20 01:12:14,967 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | +-------------+----------------------------------------+-----------------------------------------------------------------+--------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+----------------------+----------------------------------------------+--------------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+--------------------+-----------+--------+ 2021-08-20 01:12:14,969 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | job order | job status | model_origin | model_class_name | scores | scores_sd | training_times | best_iterations | nfeatures | transformers_used | num_classes | num_class | booster | seed | disable_gpus | n_gpus | score_f_name | label_counts | _build_info | gpu_id | n_jobs | random_state | pred_gap | pred_periods | ufapt | boosting_type | enable_early_stopping_rounds | learning_rate | grow_policy | max_depth | max_leaves | max_bin | scale_pos_weight | max_delta_step | gamma | colsample_bytree | subsample | subsample_freq | reg_lambda | reg_alpha | min_child_samples | min_data_in_bin | min_child_weight | min_split_gain | subsample_for_bin | class_weight | monotonicity_constraints | objective | eval_metric | early_stopping_rounds | n_estimators | importance_type | num_leaves | feature_fraction_seed | bagging_seed | num_threads | device_type | gpu_device_id | gpu_platform_id | gpu_use_dp | verbose | lossguide | silent | accuracy | time_tolerance | interpretability | ensemble_level | train_shape | valid_shape | resumed_experiment_id | str_uuid | experiment_description | train_dataset_name | valid_data_name | test_data_name | outer_trial | ngenes | ngenes_max | uses_gpu | early_stopping_threshold | early_stopping_limit | monotone_constraints | monotone_penalty | categorical_feature | monotone_constraints_method | IS_TUNING | best_learning_rate | task | experiment_id | table | tournament scores | best_scores | best_scores_sd | best_tournament scores | rel_time | rel_best_iterations | ngenes_start | nfeatures_max | feature cost | transformer | from_brain | derived_from_brain | from_brain_count | derived_from_brain_count | rel_scores | rel_tournament scores | complexity | z-score | is_best | good | 2021-08-20 01:12:14,971 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | |-------------+----------------------------------------+-----------------------------------------------------------------+--------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+----------------------+----------------------------------------------+--------------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+--------------------+-----------+--------| 2021-08-20 01:12:14,974 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 1 | PASSED | TARGET_TUNING | LightGBMModel | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | | + | 2021-08-20 01:12:14,976 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 0 | PASSED | TARGET_TUNING | LightGBMModel | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | * | + | 2021-08-20 01:12:14,978 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 1 | PASSED | TARGET_TUNING | LightGBMModel | 1.6385166645050049 | 0.04910973459482193 | 11.514583587646484 | 135 | 17 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6385166645050049 | 1.6385166645050049 | 0.04910973459482193 | 1.6385166645050049 | 0.09289908793681563 | 0.45 | 11 | 100 | 17 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9999999999999996 | 0.9999999999999996 | 1565.33 | 0.0 | | + | 2021-08-20 01:12:14,981 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 6 | PASSED | RANDOM | LightGBMModel | 1.6436718702316284 | 0.06142866984009743 | 123.9472188949585 | 300 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0.001 | 0.3 | 0.8 | 20 | 1e-06 | 10 | 50 | 10 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6436718702316284 | 1.6436718702316284 | 0.06142866984009743 | 1.6436718702316284 | 1.0 | 1 | 13 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9968636040927696 | 0.9968636040927696 | 88 | 0.1049731946050262 | | | 2021-08-20 01:12:14,983 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 3 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False | LightGBMModel | 1.669759750366211 | 0.04171554744243622 | 12.761950731277466 | 117 | 13 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 10 | 100 | True | | | [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.669759750366211 | 1.669759750366211 | 0.04171554744243622 | 1.669759750366211 | 0.10296278403868692 | 0.39 | 10 | 100 | 13 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.981288873531444 | 0.981288873531444 | 1233.29 | 0.6361892630651612 | | | 2021-08-20 01:12:14,985 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 8 | PASSED | DefaultIndiv: do_te:False,accuracy:7,interp:8,num_as_cat:False | LightGBMModel | 1.683212161064148 | 0.06572724133729935 | 39.88503384590149 | 121 | 14 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 300 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | True | | | | BeginEvolve | 1.683212161064148 | 1.683212161064148 | 0.06572724133729935 | 1.683212161064148 | 0.3217904701815282 | 0.403333 | 11 | 100 | 14 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9734463084375017 | 0.9734463084375017 | 1403 | 0.9101148057080886 | | | 2021-08-20 01:12:14,987 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | 4 | PASSED | RANDOM | LightGBMModel | 1.6909176111221313 | 0.054173633456230164 | 6.89313268661499 | 140 | 16 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | lossguide | 24 | 8 | 64 | 1 | 0 | 0 | 0.7 | 0.4 | 10 | 1 | 1 | 10 | 1 | 0.001 | 0 | 200000 | | True | mse | mae | 30 | 300 | gain | 8 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 11 | 100 | True | | | [1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | | | | BeginEvolve | 1.6909176111221313 | 1.6909176111221313 | 0.054173633456230164 | 1.6909176111221313 | 0.05561345182304341 | 0.466667 | 13 | 100 | 16 | TargetTransformer_identity_noclip | False | False | 0 | 0 | 0.9690103490125975 | 0.9690103490125975 | 41.0667 | 1.067017507821158 | | | 2021-08-20 01:12:14,989 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | | -2 | UNSCORED (ADDED AT START OF EVOLUTION) | EXTRA_FS | LightGBMModel | | | | 0 | 0 | ['InteractionsTransformer', 'OriginalTransformer'] | 1 | 1 | lightgbm | 1037348886 | False | 1 | RMSE | | {'commit': '4d0fa39', 'version': '1.10.0'} | 0 | 4 | 1037348886 | | | | gbdt | True | 0.05 | depthwise | 10 | 1024 | 64 | 1 | 0 | 0 | 0.8 | 0.7 | 1 | 0 | 0 | 1 | 1 | 0.001 | 0 | 200000 | | True | mse | rmse | 30 | 135 | gain | 1024 | 1037348887 | 1037348888 | 4 | cpu | 0 | 0 | False | -1 | False | True | 7 | 2 | 8 | 1 | (1000, 11) | | | ret_b97a3cbb-f99d-414f-aa44-cddc62776504 | buvobamu | Friedman1-results.csv | [Valid] | | (1, 2) | 12 | 100 | True | | | [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0] | 0 | | intermediate | | 0.049999999999999996 | | 59939c96-0150-11ec-a7e1-0242c0a8fe02 | BeginEvolve | | | | | | 0 | 11 | 100 | 0 | TargetTransformer_identity_noclip | False | False | 0 | 0 | | | 0 | | | | 2021-08-20 01:12:14,991 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | +-------------+----------------------------------------+-----------------------------------------------------------------+--------------------+--------------------+----------------------+--------------------+-------------------+-------------+----------------------------------------------------+---------------+-------------+-----------+------------+----------------+----------+----------------+----------------+--------------------------------------------+----------+----------+----------------+------------+----------------+---------+-----------------+--------------------------------+-----------------+---------------+-------------+--------------+-----------+--------------------+------------------+---------+--------------------+-------------+------------------+--------------+-------------+---------------------+-------------------+--------------------+------------------+---------------------+----------------+----------------------------+-------------+---------------+-------------------------+----------------+-------------------+--------------+-------------------------+----------------+---------------+---------------+-----------------+-------------------+--------------+-----------+-------------+----------+------------+------------------+--------------------+------------------+---------------+---------------+-------------------------+------------------------------------------+--------------------------+-----------------------+-------------------+------------------+---------------+----------+--------------+------------+----------------------------+------------------------+-----------------------------------------------+--------------------+-----------------------+-------------------------------+-------------+----------------------+----------------------------------------------+--------------------------------------+-------------+---------------------+--------------------+----------------------+--------------------------+---------------------+-----------------------+----------------+-----------------+----------------+-----------------------------------+--------------+----------------------+--------------------+----------------------------+--------------------+-------------------------+--------------+--------------------+-----------+--------+ 2021-08-20 01:12:15,067 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Feature Evolution population of size 6 has 2 unique transformations that include: ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:12:15,079 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Feature Evolution... 2021-08-20 01:12:15,090 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:12:15,094 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:12:15,097 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Starting Iteration: 7 2021-08-20 01:12:15,099 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:12:15,112 C: 37% D:972.9GB M:233.0GB NODE:LOCAL1 7646 INFO | Engineering features (for 1/6 base individual models out of 6 total models across folds, out of population with 6 individuals). 2021-08-20 01:12:17,107 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 INFO | Completed 72 munging tasks out of 72 total tasks (including identity) for 6 indivs and 6 folds 2021-08-20 01:12:17,118 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='1116316524', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 10) 2021-08-20 01:12:17,120 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:12:17,122 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='2835907363', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 27) 2021-08-20 01:12:17,125 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:12:17,359 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:12:17,543 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:12:17,643 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:17,646 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:12:17,648 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:17,823 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:12:17,825 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:12:17,827 C: 29% D:972.6GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:12:18,524 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 1.16499 seconds. 2021-08-20 01:12:18,535 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:12:18,537 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:12:18,590 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.04739 seconds. 2021-08-20 01:12:18,607 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:12:18,610 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:12:18,662 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:12:18,668 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.13048 seconds. 2021-08-20 01:12:18,670 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.13540 seconds. 2021-08-20 01:12:18,674 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 112 iterations: 112 2021-08-20 01:12:18,681 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.06965 seconds. 2021-08-20 01:12:18,683 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07741 seconds. 2021-08-20 01:12:19,146 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:12:19,194 C: 42% D:972.3GB M:234.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:12:48,320 C: 48% D:969.9GB M:231.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 50.4GB, since last ping: 26.5MB/s. CPU memory usage: 626.8MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.4kB/s Size: 8.8MB) (Connections: 60 Fds: 274 WinHandles: 0 Threads: 13 Maps: 3998 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 13% Wait: 3% DAIActiveprocs: 1 DAIprocs: 45) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_7)_score_train-training_xgb_indiv_5_fold_4] 2021-08-20 01:13:45,974 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:13:45,984 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:13:45,987 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:13:45,989 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:13:46,027 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:13:46,029 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:13:46,795 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 87.58910 seconds. 2021-08-20 01:13:46,810 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:13:46,812 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 87.66654 seconds. 2021-08-20 01:13:46,814 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:13:46,824 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:13:46,826 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:13:46,890 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 132 iterations: 132 2021-08-20 01:13:46,892 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 134 iterations: 134 2021-08-20 01:13:46,895 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.08239 seconds. 2021-08-20 01:13:46,897 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07054 seconds. 2021-08-20 01:13:46,899 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.08792 seconds. 2021-08-20 01:13:46,901 C: 41% D:970.6GB M:238.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07533 seconds. 2021-08-20 01:13:47,246 C: 44% D:970.2GB M:239.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 4 5 and Completed 9 training tasks out of 6 total tasks for 6 indivs and 6 folds 2021-08-20 01:13:47,389 C: 44% D:970.2GB M:239.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:13:47,493 C: 44% D:970.2GB M:239.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:13:52,747 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:13:52,754 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:13:52,756 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:13:53,220 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 55.6GB, since last ping: 5.5MB/s. CPU memory usage: 622.9MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 78.2kB/s Size: 8.8MB) (Connections: 60 Fds: 268 WinHandles: 0 Threads: 13 Maps: 3993 WinOpenFiles: 0) (System-Wide CPU: User: 33% Nice: 0% System: 12% Wait: 3% DAIActiveprocs: 2 DAIprocs: 43) . [|#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_7)_score_train 1 (1) (True) [119.8] [0.0]] 2021-08-20 01:13:53,526 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 6.13661 seconds. 2021-08-20 01:13:53,538 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:13:53,540 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:13:53,618 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 93 iterations: 93 2021-08-20 01:13:53,623 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.08244 seconds. 2021-08-20 01:13:53,626 C: 19% D:969.0GB M:238.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08802 seconds. 2021-08-20 01:14:50,822 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:14:50,829 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:14:50,830 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:14:51,527 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 64.03353 seconds. 2021-08-20 01:14:51,539 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:14:51,542 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:14:51,609 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:14:51,614 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07241 seconds. 2021-08-20 01:14:51,616 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07770 seconds. 2021-08-20 01:14:51,807 C: 17% D:967.2GB M:237.4GB NODE:LOCAL1 7646 INFO | Completed 11 training tasks out of 6 total tasks for 6 indivs and 6 folds 2021-08-20 01:14:53,387 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 97, model transformed features: 5, total model time: 1.5071, fit model time: 1.5062 2021-08-20 01:14:53,392 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 112, model transformed features: 5, total model time: 1.3428, fit model time: 1.342 2021-08-20 01:14:53,394 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 134, model transformed features: 5, total model time: 87.946, fit model time: 87.945 2021-08-20 01:14:53,396 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 132, model transformed features: 5, total model time: 87.903, fit model time: 87.902 2021-08-20 01:14:53,397 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 93, model transformed features: 5, total model time: 6.4386, fit model time: 6.4376 2021-08-20 01:14:53,399 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 106, model transformed features: 5, total model time: 64.296, fit model time: 64.295 2021-08-20 01:14:53,790 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,836 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,873 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,940 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6832 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:53,942 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6909 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:14:54,012 C: 19% D:967.8GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.7786 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:14:55,107 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Munge time: 2.0291 s, Train time: 154.6828 s, Score time: 1.7351 s 2021-08-20 01:14:55,628 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:14:55,925 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:14:55,935 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:14:55,938 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Time so far: 1566 secs 2021-08-20 01:14:55,941 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Stopping in: 84833 secs 2021-08-20 01:14:55,985 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Experiment Progress: 9.89 % 2021-08-20 01:14:56,084 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Scored 67/598 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:14:56,096 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:14:56,099 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:14:56,101 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:14:56,103 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:14:56,105 C: 17% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.683212 +/- 0.06572724 [Tournament: 1.683212 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:14:56,108 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.690918 +/- 0.05417363 [Tournament: 1.690918 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:14:56,116 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.778612 +/- 0.07008359 [Tournament: 1.778612 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:14:56,119 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 11 transformers creating 17 total features and 17 features for model: 1.638517 RMSE 2021-08-20 01:14:56,121 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:14:56,123 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:14:56,126 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:14:56,128 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.924512 2021-08-20 01:14:56,131 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 2 4_X_4 0.285088 2021-08-20 01:14:56,135 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 3 2_X_2 0.216417 2021-08-20 01:14:56,137 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.142693 2021-08-20 01:14:56,140 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 5 10_InteractionDiv:X_0:X_2 0.060810 2021-08-20 01:14:56,143 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 6 6_X_6 0.042800 2021-08-20 01:14:56,145 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 7 5_X_5 0.042103 2021-08-20 01:14:56,148 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.041284 2021-08-20 01:14:56,151 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_1:X_2 0.040709 2021-08-20 01:14:56,154 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:14:56,157 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:14:56,159 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Starting Iteration: 8 2021-08-20 01:14:56,161 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:14:56,895 C: 13% D:969.4GB M:238.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 63.4GB, since last ping: 37.0MB/s. CPU memory usage: 519.9MB, max: 894.3MB CPU: 199% Procs: 8 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/8388608 (OpenFilesUser: 0) PSThreads: 12 (Disk: Read: 0B/s Write: 213.0kB/s Size: 8.5MB) (Connections: 34 Fds: 167 WinHandles: 0 Threads: 7 Maps: 2404 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 6% Wait: 9% DAIActiveprocs: 3 DAIprocs: 36) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_Evolution-mutating: mutation_rate = 1:begin] 2021-08-20 01:14:58,425 C: 28% D:969.3GB M:239.4GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:15:01,653 C: 32% D:969.2GB M:238.2GB NODE:LOCAL1 7646 INFO | Completed 162 munging tasks out of 162 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:15:01,938 C: 32% D:969.2GB M:238.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:15:02,032 C: 32% D:969.2GB M:238.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:16:01,966 C: 17% D:963.1GB M:234.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 71.2GB, since last ping: 23.3MB/s. CPU memory usage: 625.3MB, max: 894.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 8.9MB) (Connections: 58 Fds: 265 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 12% Nice: 0% System: 7% Wait: 6% DAIActiveprocs: 3 DAIprocs: 37) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_3_fold_2] 2021-08-20 01:16:25,333 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:16:25,341 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:16:25,343 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:16:26,303 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 84.27103 seconds. 2021-08-20 01:16:26,315 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:16:26,318 C: 38% D:962.4GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:16:26,395 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 122 iterations: 122 2021-08-20 01:16:26,402 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08395 seconds. 2021-08-20 01:16:26,404 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.08947 seconds. 2021-08-20 01:16:26,652 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 2 3 and Completed 5 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:16:26,661 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:16:26,664 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Time: 84.8828 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 128, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:16:26,668 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:16:26,678 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | Time: 84.8828 s: LIGHTGBM 2021-08-20 01:16:26,705 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:16:26,708 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:16:26,711 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:16:26,786 C: 37% D:962.1GB M:234.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:16:27,980 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 86.04095 seconds. 2021-08-20 01:16:27,994 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:16:27,996 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:16:28,075 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:16:28,082 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.08507 seconds. 2021-08-20 01:16:28,084 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.08990 seconds. 2021-08-20 01:16:28,413 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) start. 2021-08-20 01:16:28,443 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:16:28,445 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:16:28,447 C: 32% D:960.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:16:29,682 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 2.88783 seconds. 2021-08-20 01:16:29,700 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:16:29,704 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:16:29,780 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:16:29,788 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08428 seconds. 2021-08-20 01:16:29,791 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09143 seconds. 2021-08-20 01:16:30,148 C: 29% D:959.7GB M:232.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:17:12,711 C: 29% D:956.4GB M:224.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 77.6GB, since last ping: 20.2MB/s. CPU memory usage: 623.7MB, max: 894.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 8.9MB) (Connections: 58 Fds: 287 WinHandles: 0 Threads: 13 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 10% Wait: 9% DAIActiveprocs: 4 DAIprocs: 39) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_3_fold_5] 2021-08-20 01:17:45,076 C: 17% D:959.0GB M:227.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:45,082 C: 17% D:959.0GB M:227.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:17:45,084 C: 17% D:959.0GB M:227.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:17:47,485 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 75.93039 seconds. 2021-08-20 01:17:47,500 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:17:47,503 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:17:47,584 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 115 iterations: 115 2021-08-20 01:17:47,593 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08861 seconds. 2021-08-20 01:17:47,597 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.09586 seconds. 2021-08-20 01:17:47,868 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 5 6 and Completed 8 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:17:47,872 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:17:47,875 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 DATA | Time: 79.5987 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 128, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:17:47,877 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:17:47,880 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | Time: 79.5987 s: LIGHTGBM 2021-08-20 01:17:48,005 C: 16% D:958.9GB M:226.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) start. 2021-08-20 01:17:49,316 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:49,324 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:17:49,326 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:17:50,284 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 8) end. Took 2.27929 seconds. 2021-08-20 01:17:50,295 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) start. 2021-08-20 01:17:50,298 C: 24% D:957.9GB M:226.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) start. 2021-08-20 01:17:50,374 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 111 iterations: 111 2021-08-20 01:17:50,382 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 8) model predict (333, 8) end. Took 0.08280 seconds. 2021-08-20 01:17:50,385 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 9) end. Took 0.08932 seconds. 2021-08-20 01:17:50,715 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:17:50,780 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:50,783 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:17:50,785 C: 34% D:956.6GB M:226.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:17:51,713 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 8) end. Took 83.29943 seconds. 2021-08-20 01:17:51,724 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) start. 2021-08-20 01:17:51,726 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) start. 2021-08-20 01:17:51,795 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 107 iterations: 107 2021-08-20 01:17:51,801 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 8) model predict (334, 8) end. Took 0.07389 seconds. 2021-08-20 01:17:51,803 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 9) end. Took 0.07930 seconds. 2021-08-20 01:17:52,163 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:17:52,192 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:52,194 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:17:52,196 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:17:52,633 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 1.91862 seconds. 2021-08-20 01:17:52,645 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:17:52,647 C: 25% D:956.4GB M:224.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:17:52,718 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:17:52,726 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.07862 seconds. 2021-08-20 01:17:52,729 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.08403 seconds. 2021-08-20 01:17:53,050 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:53,052 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:17:53,054 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:17:53,069 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:17:53,468 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.30469 seconds. 2021-08-20 01:17:53,479 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:17:53,481 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:17:53,551 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:17:53,558 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07601 seconds. 2021-08-20 01:17:53,560 C: 27% D:958.6GB M:223.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.08148 seconds. 2021-08-20 01:17:53,901 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:17:53,953 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:53,955 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:17:53,957 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:17:54,389 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.31977 seconds. 2021-08-20 01:17:54,399 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:17:54,401 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:17:54,467 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 299 iterations: 299 2021-08-20 01:17:54,473 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07133 seconds. 2021-08-20 01:17:54,475 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.07630 seconds. 2021-08-20 01:17:54,827 C: 42% D:958.5GB M:227.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:17:56,880 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:17:56,886 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:17:56,888 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:17:57,343 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 3.44198 seconds. 2021-08-20 01:17:57,354 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:17:57,357 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:17:57,419 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:17:57,426 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.06964 seconds. 2021-08-20 01:17:57,429 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.07460 seconds. 2021-08-20 01:17:57,789 C: 25% D:958.4GB M:225.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:18:02,719 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:18:02,728 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:18:02,730 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:18:03,319 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 8.49104 seconds. 2021-08-20 01:18:03,331 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:18:03,334 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:18:03,401 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:18:03,408 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.07360 seconds. 2021-08-20 01:18:03,410 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.07939 seconds. 2021-08-20 01:18:03,625 C: 17% D:958.1GB M:223.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 0 13 and Completed 15 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:18:03,779 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:18:03,808 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:18:03,810 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:18:03,812 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:18:04,206 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 6.41676 seconds. 2021-08-20 01:18:04,219 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:18:04,222 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:18:04,301 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 298 iterations: 298 2021-08-20 01:18:04,308 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.08551 seconds. 2021-08-20 01:18:04,311 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.09178 seconds. 2021-08-20 01:18:04,692 C: 30% D:958.1GB M:223.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:18:16,981 C: 30% D:958.6GB M:230.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 86.2GB, since last ping: 29.6MB/s. CPU memory usage: 622.4MB, max: 894.3MB CPU: 59% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 38.3kB/s Size: 9.0MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 20% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 4 DAIprocs: 39) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_5_fold_2] 2021-08-20 01:19:20,024 C: 16% D:959.1GB M:235.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:20,033 C: 16% D:959.1GB M:235.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:19:20,035 C: 16% D:959.1GB M:235.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:21,709 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 90.4GB, since last ping: 18.5MB/s. CPU memory usage: 623.8MB, max: 894.3MB CPU: 30% Procs: 5 . GPU memory usage: 149.9MB, max: 299.9MB GPUs usage: 1% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.0MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 14% Nice: 0% System: 7% Wait: 4% DAIActiveprocs: 3 DAIprocs: 34) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_8)_score_train-training_xgb_indiv_5_fold_2] 2021-08-20 01:19:21,716 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 77.02218 seconds. 2021-08-20 01:19:21,727 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:21,730 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:21,802 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 207 iterations: 207 2021-08-20 01:19:21,814 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08207 seconds. 2021-08-20 01:19:21,818 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08908 seconds. 2021-08-20 01:19:22,069 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 2 15 and Completed 17 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:22,072 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:19:22,075 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Time: 78.4504 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'depthwise', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'TARGET_TUNING', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 11, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:19:22,078 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:19:22,080 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | Time: 78.4504 s: LIGHTGBM 2021-08-20 01:19:22,209 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:19:22,548 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:22,550 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:19:22,552 C: 25% D:959.1GB M:236.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:24,621 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 80.30962 seconds. 2021-08-20 01:19:24,634 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:19:24,636 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:19:24,719 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:19:24,729 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.09144 seconds. 2021-08-20 01:19:24,732 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.09738 seconds. 2021-08-20 01:19:25,212 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:25,214 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:19:25,217 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:25,229 C: 25% D:959.1GB M:237.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:19:26,214 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 4.00513 seconds. 2021-08-20 01:19:26,224 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:26,227 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:26,298 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 122 iterations: 122 2021-08-20 01:19:26,306 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07828 seconds. 2021-08-20 01:19:26,309 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08387 seconds. 2021-08-20 01:19:26,943 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:19:26,955 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:26,957 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:19:26,959 C: 24% D:959.0GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:27,997 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 2.76761 seconds. 2021-08-20 01:19:28,017 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:19:28,021 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:19:28,095 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 124 iterations: 124 2021-08-20 01:19:28,107 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.08237 seconds. 2021-08-20 01:19:28,111 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.09408 seconds. 2021-08-20 01:19:28,389 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:28,396 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:19:28,399 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:28,504 C: 31% D:958.9GB M:236.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:19:29,434 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 2.49087 seconds. 2021-08-20 01:19:29,444 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:29,446 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:29,524 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 126 iterations: 126 2021-08-20 01:19:29,529 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08206 seconds. 2021-08-20 01:19:29,531 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08704 seconds. 2021-08-20 01:19:29,914 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) start. 2021-08-20 01:19:29,941 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:19:29,943 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:19:29,945 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:30,174 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:30,178 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.36014', 'X_3': '0.56708'} 2021-08-20 01:19:30,181 C: 27% D:958.7GB M:236.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:30,527 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) end. Took 0.61346 seconds. 2021-08-20 01:19:30,539 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) start. 2021-08-20 01:19:30,542 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) start. 2021-08-20 01:19:30,622 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:30,630 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) end. Took 0.08574 seconds. 2021-08-20 01:19:30,634 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) end. Took 0.09296 seconds. 2021-08-20 01:19:30,779 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 2.27489 seconds. 2021-08-20 01:19:30,796 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:19:30,800 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:19:30,875 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:19:30,881 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08197 seconds. 2021-08-20 01:19:30,884 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08890 seconds. 2021-08-20 01:19:30,986 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:31,223 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:31,260 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:31,262 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37831', 'X_3': '0.58737'} 2021-08-20 01:19:31,264 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:31,487 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:31,490 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.33556', 'X_3': '0.60792'} 2021-08-20 01:19:31,493 C: 27% D:958.6GB M:237.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:31,623 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.63696 seconds. 2021-08-20 01:19:31,634 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:31,637 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:31,705 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:31,710 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07292 seconds. 2021-08-20 01:19:31,713 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.07821 seconds. 2021-08-20 01:19:31,864 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.64098 seconds. 2021-08-20 01:19:31,874 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:31,876 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:31,943 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 120 iterations: 120 2021-08-20 01:19:31,948 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07171 seconds. 2021-08-20 01:19:31,951 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.07639 seconds. 2021-08-20 01:19:32,156 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) start. 2021-08-20 01:19:32,207 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 7 fold_id= 4 23 and Completed 25 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:32,334 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:32,525 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:32,527 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.37401', 'X_3': '0.60371'} 2021-08-20 01:19:32,529 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:32,622 C: 30% D:958.5GB M:237.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:32,624 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.35415', 'X_3': '0.57112'} 2021-08-20 01:19:32,632 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:32,910 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 2) end. Took 0.75344 seconds. 2021-08-20 01:19:32,922 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) start. 2021-08-20 01:19:32,924 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) start. 2021-08-20 01:19:32,995 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:19:32,999 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.66495 seconds. 2021-08-20 01:19:33,001 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 2) model predict (334, 2) end. Took 0.07595 seconds. 2021-08-20 01:19:33,003 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 3) end. Took 0.08156 seconds. 2021-08-20 01:19:33,010 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:33,013 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:33,084 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:33,092 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07700 seconds. 2021-08-20 01:19:33,095 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.08376 seconds. 2021-08-20 01:19:33,364 C: 30% D:958.4GB M:237.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) start. 2021-08-20 01:19:33,842 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_1': 1, 'X_3': 1} 2021-08-20 01:19:33,848 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_1': '0.34500', 'X_3': '0.58786'} 2021-08-20 01:19:33,849 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:34,209 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 2) end. Took 0.84402 seconds. 2021-08-20 01:19:34,219 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) start. 2021-08-20 01:19:34,222 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) start. 2021-08-20 01:19:34,296 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:19:34,302 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 2) model predict (333, 2) end. Took 0.07974 seconds. 2021-08-20 01:19:34,305 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 3) end. Took 0.08520 seconds. 2021-08-20 01:19:34,710 C: 29% D:958.3GB M:237.5GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:36,763 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 122, model transformed features: 8, total model time: 84.573, fit model time: 84.572 2021-08-20 01:19:36,772 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 124, model transformed features: 8, total model time: 86.359, fit model time: 86.358 2021-08-20 01:19:36,774 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 139, model transformed features: 8, total model time: 3.2003, fit model time: 3.1993 2021-08-20 01:19:36,776 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 115, model transformed features: 8, total model time: 77.668, fit model time: 77.667 2021-08-20 01:19:36,778 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 111, model transformed features: 8, total model time: 2.575, fit model time: 2.5741 2021-08-20 01:19:36,780 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 107, model transformed features: 8, total model time: 83.579, fit model time: 83.579 2021-08-20 01:19:36,782 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 2.2085, fit model time: 2.2076 2021-08-20 01:19:36,784 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 1.5938, fit model time: 1.593 2021-08-20 01:19:36,786 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 299, model transformed features: 14, total model time: 1.5938, fit model time: 1.5928 2021-08-20 01:19:36,788 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 14, total model time: 3.7249, fit model time: 3.7239 2021-08-20 01:19:36,790 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 8.7884, fit model time: 8.7873 2021-08-20 01:19:36,792 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 298, model transformed features: 14, total model time: 6.735, fit model time: 6.7341 2021-08-20 01:19:36,794 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 207, model transformed features: 13, total model time: 77.328, fit model time: 77.327 2021-08-20 01:19:36,796 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 150, model transformed features: 13, total model time: 81.178, fit model time: 81.177 2021-08-20 01:19:36,798 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 122, model transformed features: 13, total model time: 4.3006, fit model time: 4.2996 2021-08-20 01:19:36,800 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 124, model transformed features: 13, total model time: 3.1277, fit model time: 3.1264 2021-08-20 01:19:36,802 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 126, model transformed features: 13, total model time: 2.7912, fit model time: 2.7902 2021-08-20 01:19:36,804 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 105, model transformed features: 13, total model time: 2.5795, fit model time: 2.5786 2021-08-20 01:19:36,806 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 0.93734, fit model time: 0.93647 2021-08-20 01:19:36,808 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 0.93104, fit model time: 0.92977 2021-08-20 01:19:36,810 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 120, model transformed features: 2, total model time: 0.9137, fit model time: 0.91285 2021-08-20 01:19:36,812 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 106, model transformed features: 2, total model time: 1.088, fit model time: 1.087 2021-08-20 01:19:36,814 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 0.95901, fit model time: 0.95799 2021-08-20 01:19:36,816 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 135, model transformed features: 2, total model time: 1.1626, fit model time: 1.1614 2021-08-20 01:19:37,248 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.7786 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:19:37,295 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,343 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,373 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,426 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6439 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:37,447 C: 31% D:957.9GB M:235.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6224 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:38,310 C: 36% D:957.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:19:38,329 C: 36% D:957.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=3.4508 LIGHTGBM ['OriginalTransformer'] 2021-08-20 01:19:39,066 C: 36% D:957.2GB M:235.5GB NODE:LOCAL1 7646 INFO | Munge time: 3.2637 s, Train time: 273.0469 s, Score time: 2.3053 s 2021-08-20 01:19:39,404 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Updated total models to train from 598 -> 310 for number of individuals 8 -> 8 2021-08-20 01:19:39,526 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:19:39,961 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:19:39,978 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:19:39,981 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Time so far: 1850 secs 2021-08-20 01:19:39,984 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Stopping in: 84549 secs 2021-08-20 01:19:40,031 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Experiment Progress: 25.4 % 2021-08-20 01:19:40,104 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Scored 91/310 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:19:40,113 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:19:40,116 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:19:40,118 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.622405 +/- 0.05499941 [Tournament: 1.622405 Model: LIGHTGBM Feature Cost: 15] 2021-08-20 01:19:40,120 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:19:40,122 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:19:40,124 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.643852 +/- 0.06142867 [Tournament: 1.643852 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:19:40,126 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:19:40,127 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.778612 +/- 0.07008359 [Tournament: 1.778612 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:19:40,130 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Individual 7 : 3.450785 +/- 0.06098503 [Tournament: 3.450785 Model: LIGHTGBM Feature Cost: 2] 2021-08-20 01:19:40,132 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 5 transformers creating 8 total features and 8 features for model: 1.619091 RMSE 2021-08-20 01:19:40,134 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | Top 8 variable importances of best individual: 2021-08-20 01:19:40,137 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:19:40,139 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:19:40,142 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.788475 2021-08-20 01:19:40,144 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 2 2_X_2 0.296163 2021-08-20 01:19:40,147 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.295632 2021-08-20 01:19:40,150 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.276633 2021-08-20 01:19:40,152 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 5 10_InteractionSub:X_0:X_1 0.086895 2021-08-20 01:19:40,155 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 6 5_X_5 0.077826 2021-08-20 01:19:40,157 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.031322 2021-08-20 01:19:40,161 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:19:40,163 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:19:40,166 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | Starting Iteration: 9 2021-08-20 01:19:40,168 C: 28% D:957.2GB M:235.2GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:19:42,895 C: 29% D:958.0GB M:236.9GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:19:44,357 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 INFO | Completed 168 munging tasks out of 168 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:19:44,373 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Pruned InteractionsGene(num_cols=['X_0', 'X_1', 'X_2', 'X_3', 'X_4', 'X_5', 'X_6', 'X_7', 'X_8', 'X_9'], interactions_funcs=['__add__', '__truediv__', '__sub__', '__mul__'], new_cols='None', random_state='3875894129', output_features_to_drop=[], labels='None'):active because transformation failed (GA invalid or segfault): (5, 0, 13) 2021-08-20 01:19:44,377 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 WARNING| Pruned InteractionsGene 2021-08-20 01:19:44,664 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:19:44,764 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:44,936 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:44,938 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:19:44,941 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:45,198 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:45,200 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:19:45,203 C: 30% D:957.9GB M:236.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:46,215 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.45108 seconds. 2021-08-20 01:19:46,226 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:46,228 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:46,293 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 120 iterations: 120 2021-08-20 01:19:46,300 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07116 seconds. 2021-08-20 01:19:46,302 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07641 seconds. 2021-08-20 01:19:46,542 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.87390 seconds. 2021-08-20 01:19:46,555 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:19:46,558 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:19:46,627 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 157 iterations: 157 2021-08-20 01:19:46,634 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07620 seconds. 2021-08-20 01:19:46,637 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08159 seconds. 2021-08-20 01:19:46,648 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:46,904 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:46,907 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:19:46,909 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:46,978 C: 37% D:957.9GB M:236.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) start. 2021-08-20 01:19:47,252 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:47,259 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:19:47,260 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:47,932 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.28356 seconds. 2021-08-20 01:19:47,943 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:47,946 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:48,019 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:19:48,026 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07889 seconds. 2021-08-20 01:19:48,029 C: 31% D:957.9GB M:236.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.08511 seconds. 2021-08-20 01:19:48,395 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:48,656 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:48,659 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:19:48,661 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:48,696 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 15) end. Took 1.71721 seconds. 2021-08-20 01:19:48,712 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) start. 2021-08-20 01:19:48,715 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) start. 2021-08-20 01:19:48,787 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:19:48,795 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 15) model predict (334, 15) end. Took 0.07914 seconds. 2021-08-20 01:19:48,797 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 16) end. Took 0.08552 seconds. 2021-08-20 01:19:49,152 C: 40% D:957.9GB M:236.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) start. 2021-08-20 01:19:49,436 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:19:49,442 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:19:49,444 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:19:49,661 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.26553 seconds. 2021-08-20 01:19:49,673 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:49,676 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:49,756 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 115 iterations: 115 2021-08-20 01:19:49,764 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.08737 seconds. 2021-08-20 01:19:49,766 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.09329 seconds. 2021-08-20 01:19:50,125 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:19:50,339 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 15) end. Took 1.18788 seconds. 2021-08-20 01:19:50,350 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) start. 2021-08-20 01:19:50,352 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) start. 2021-08-20 01:19:50,417 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 100 iterations: 100 2021-08-20 01:19:50,423 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 15) model predict (333, 15) end. Took 0.07062 seconds. 2021-08-20 01:19:50,426 C: 39% D:957.5GB M:235.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 16) end. Took 0.07614 seconds. 2021-08-20 01:19:50,780 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:50,888 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:50,891 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:19:50,894 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:19:51,175 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:51,177 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:19:51,180 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:19:51,538 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 1.41334 seconds. 2021-08-20 01:19:51,549 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:19:51,551 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:19:51,624 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 147 iterations: 147 2021-08-20 01:19:51,631 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.07887 seconds. 2021-08-20 01:19:51,633 C: 36% D:957.5GB M:235.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.08395 seconds. 2021-08-20 01:19:51,844 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.06272 seconds. 2021-08-20 01:19:51,861 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:51,864 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:51,931 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 139 iterations: 139 2021-08-20 01:19:51,937 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.07315 seconds. 2021-08-20 01:19:51,939 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.07934 seconds. 2021-08-20 01:19:51,969 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:52,462 C: 34% D:957.5GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:19:52,872 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:52,877 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:19:52,879 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:19:52,959 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:52,962 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:19:52,964 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:19:53,487 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.52063 seconds. 2021-08-20 01:19:53,504 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:53,507 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:53,590 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:19:53,599 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.09029 seconds. 2021-08-20 01:19:53,602 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.09864 seconds. 2021-08-20 01:19:53,626 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 1.16424 seconds. 2021-08-20 01:19:53,641 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:19:53,644 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:19:53,707 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 158 iterations: 158 2021-08-20 01:19:53,713 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.06893 seconds. 2021-08-20 01:19:53,715 C: 31% D:957.4GB M:234.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.07402 seconds. 2021-08-20 01:19:54,332 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:54,445 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:19:54,775 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:19:54,777 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:19:54,780 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:19:54,863 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:19:54,865 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:19:54,867 C: 35% D:957.8GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:19:55,487 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.15501 seconds. 2021-08-20 01:19:55,499 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:55,502 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:55,514 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 1.06956 seconds. 2021-08-20 01:19:55,526 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:19:55,528 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:19:55,577 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 150 iterations: 150 2021-08-20 01:19:55,584 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.08171 seconds. 2021-08-20 01:19:55,587 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.08765 seconds. 2021-08-20 01:19:55,598 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 133 iterations: 133 2021-08-20 01:19:55,606 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.07592 seconds. 2021-08-20 01:19:55,610 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.08269 seconds. 2021-08-20 01:19:55,916 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 0 13 and Completed 16 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:19:56,056 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) start. 2021-08-20 01:19:56,183 C: 37% D:957.4GB M:235.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:01,758 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:01,764 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024'} 2021-08-20 01:20:01,766 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:01,972 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:01,975 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019'} 2021-08-20 01:20:01,978 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:02,335 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) end. Took 6.27929 seconds. 2021-08-20 01:20:02,346 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) start. 2021-08-20 01:20:02,348 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) start. 2021-08-20 01:20:02,391 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 6.20720 seconds. 2021-08-20 01:20:02,402 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:02,404 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:02,417 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:02,424 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) end. Took 0.07411 seconds. 2021-08-20 01:20:02,427 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) end. Took 0.08073 seconds. 2021-08-20 01:20:02,473 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:02,478 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07297 seconds. 2021-08-20 01:20:02,480 C: 20% D:957.8GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.07838 seconds. 2021-08-20 01:20:03,043 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:03,183 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) start. 2021-08-20 01:20:03,369 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:03,371 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105'} 2021-08-20 01:20:03,373 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:03,432 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:03,435 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946'} 2021-08-20 01:20:03,437 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:03,845 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.80173 seconds. 2021-08-20 01:20:03,854 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:03,856 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:03,894 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 4) end. Took 0.71019 seconds. 2021-08-20 01:20:03,906 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) start. 2021-08-20 01:20:03,908 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) start. 2021-08-20 01:20:03,926 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 43 iterations: 43 2021-08-20 01:20:03,931 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07366 seconds. 2021-08-20 01:20:03,933 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.07850 seconds. 2021-08-20 01:20:03,973 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:03,978 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 4) model predict (334, 4) end. Took 0.06890 seconds. 2021-08-20 01:20:03,980 C: 26% D:957.7GB M:235.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 5) end. Took 0.07456 seconds. 2021-08-20 01:20:04,685 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:04,802 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) start. 2021-08-20 01:20:04,986 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:04,988 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996'} 2021-08-20 01:20:04,991 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:05,075 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1} 2021-08-20 01:20:05,076 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150'} 2021-08-20 01:20:05,081 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:05,504 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.81858 seconds. 2021-08-20 01:20:05,516 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:05,518 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:05,577 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 4) end. Took 0.77443 seconds. 2021-08-20 01:20:05,586 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 36 iterations: 36 2021-08-20 01:20:05,587 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) start. 2021-08-20 01:20:05,590 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.07205 seconds. 2021-08-20 01:20:05,593 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.07747 seconds. 2021-08-20 01:20:05,641 C: 22% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) start. 2021-08-20 01:20:05,712 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 27 iterations: 27 2021-08-20 01:20:05,718 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 4) model predict (333, 4) end. Took 0.12677 seconds. 2021-08-20 01:20:05,721 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 5) end. Took 0.13288 seconds. 2021-08-20 01:20:05,998 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:20:06,095 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 7 fold_id= 1 20 and Completed 22 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:06,231 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:06,264 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:06,266 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:06,268 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:06,638 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:06,640 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:06,642 C: 26% D:957.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:07,060 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 1.06205 seconds. 2021-08-20 01:20:07,072 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:20:07,074 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:20:07,142 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 97 iterations: 97 2021-08-20 01:20:07,149 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.07406 seconds. 2021-08-20 01:20:07,151 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.07959 seconds. 2021-08-20 01:20:07,465 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.23308 seconds. 2021-08-20 01:20:07,480 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:07,483 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:07,552 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 105 iterations: 105 2021-08-20 01:20:07,559 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.07623 seconds. 2021-08-20 01:20:07,562 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.08258 seconds. 2021-08-20 01:20:07,631 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:07,966 C: 28% D:957.7GB M:234.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) start. 2021-08-20 01:20:08,307 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:08,315 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:08,316 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:08,558 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:08,563 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:08,567 C: 32% D:957.7GB M:233.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:09,972 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.34017 seconds. 2021-08-20 01:20:09,989 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:09,994 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:10,100 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:20:10,108 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.11383 seconds. 2021-08-20 01:20:10,112 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.12294 seconds. 2021-08-20 01:20:10,500 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 10) end. Took 2.53458 seconds. 2021-08-20 01:20:10,513 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) start. 2021-08-20 01:20:10,516 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) start. 2021-08-20 01:20:10,586 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:10,602 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:20:10,610 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 10) model predict (334, 10) end. Took 0.09321 seconds. 2021-08-20 01:20:10,614 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 11) end. Took 0.09987 seconds. 2021-08-20 01:20:10,906 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:10,909 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:10,912 C: 76% D:957.6GB M:232.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:11,070 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) start. 2021-08-20 01:20:11,429 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:11,433 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:20:11,438 C: 68% D:957.6GB M:231.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:12,762 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 2.17511 seconds. 2021-08-20 01:20:12,778 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:12,782 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:12,906 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 125 iterations: 125 2021-08-20 01:20:12,913 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.13101 seconds. 2021-08-20 01:20:12,916 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.13893 seconds. 2021-08-20 01:20:12,998 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 10) end. Took 1.92790 seconds. 2021-08-20 01:20:13,021 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) start. 2021-08-20 01:20:13,024 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) start. 2021-08-20 01:20:13,124 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 116 iterations: 116 2021-08-20 01:20:13,131 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 10) model predict (333, 10) end. Took 0.10870 seconds. 2021-08-20 01:20:13,134 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 11) end. Took 0.11709 seconds. 2021-08-20 01:20:13,350 C: 85% D:957.5GB M:231.2GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:16,288 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 120, model transformed features: 15, total model time: 1.721, fit model time: 1.7201 2021-08-20 01:20:16,294 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 157, model transformed features: 15, total model time: 2.1816, fit model time: 2.1805 2021-08-20 01:20:16,296 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 106, model transformed features: 15, total model time: 1.5781, fit model time: 1.5772 2021-08-20 01:20:16,299 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 150, model transformed features: 15, total model time: 2.0308, fit model time: 2.0294 2021-08-20 01:20:16,301 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 115, model transformed features: 15, total model time: 1.5847, fit model time: 1.5836 2021-08-20 01:20:16,303 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 100, model transformed features: 15, total model time: 1.4743, fit model time: 1.4735 2021-08-20 01:20:16,304 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 147, model transformed features: 11, total model time: 1.7024, fit model time: 1.7016 2021-08-20 01:20:16,306 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 139, model transformed features: 11, total model time: 1.3481, fit model time: 1.3471 2021-08-20 01:20:16,308 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 105, model transformed features: 11, total model time: 1.8411, fit model time: 1.8401 2021-08-20 01:20:16,310 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 158, model transformed features: 11, total model time: 1.4434, fit model time: 1.4425 2021-08-20 01:20:16,312 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 150, model transformed features: 11, total model time: 1.4846, fit model time: 1.4837 2021-08-20 01:20:16,314 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 133, model transformed features: 11, total model time: 1.3442, fit model time: 1.3432 2021-08-20 01:20:16,316 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 6.5703, fit model time: 6.5695 2021-08-20 01:20:16,318 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 6.48, fit model time: 6.4791 2021-08-20 01:20:16,319 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 43, model transformed features: 4, total model time: 1.0739, fit model time: 1.073 2021-08-20 01:20:16,321 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 0.98109, fit model time: 0.98016 2021-08-20 01:20:16,323 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 36, model transformed features: 4, total model time: 1.1448, fit model time: 1.1439 2021-08-20 01:20:16,325 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 27, model transformed features: 4, total model time: 1.0986, fit model time: 1.0977 2021-08-20 01:20:16,327 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 97, model transformed features: 10, total model time: 1.3677, fit model time: 1.3669 2021-08-20 01:20:16,329 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 105, model transformed features: 10, total model time: 1.5294, fit model time: 1.5286 2021-08-20 01:20:16,332 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 10, total model time: 2.6918, fit model time: 2.6906 2021-08-20 01:20:16,334 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 10, total model time: 2.8835, fit model time: 2.8826 2021-08-20 01:20:16,336 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 125, model transformed features: 10, total model time: 2.601, fit model time: 2.5999 2021-08-20 01:20:16,338 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 116, model transformed features: 10, total model time: 2.3034, fit model time: 2.3024 2021-08-20 01:20:16,901 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6844 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,004 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6544 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,021 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,130 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:17,185 C: 77% D:957.4GB M:229.8GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:18,391 C: 81% D:956.9GB M:227.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=4.0426 LIGHTGBM ['InteractionsTransformer'] 2021-08-20 01:20:18,482 C: 81% D:956.9GB M:227.7GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:18,505 C: 81% D:956.9GB M:227.7GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.6595 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:19,887 C: 76% D:956.8GB M:227.6GB NODE:LOCAL1 7646 INFO | Munge time: 1.5110 s, Train time: 28.9688 s, Score time: 3.2849 s 2021-08-20 01:20:20,567 C: 76% D:956.8GB M:227.6GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:20:21,150 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:20:21,178 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:20:21,181 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Time so far: 1891 secs 2021-08-20 01:20:21,184 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Stopping in: 84508 secs 2021-08-20 01:20:21,254 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Experiment Progress: 32.1 % 2021-08-20 01:20:21,347 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Scored 115/310 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:20:21,360 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:20:21,363 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:20:21,365 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:20:21,367 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:20:21,369 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.654428 +/- 0.05772004 [Tournament: 1.654428 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:20:21,371 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.659539 +/- 0.05454549 [Tournament: 1.659539 Model: LIGHTGBM Feature Cost: 10] 2021-08-20 01:20:21,373 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:20:21,374 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.68438 +/- 0.04906118 [Tournament: 1.68438 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:20:21,376 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Individual 7 : 4.042583 +/- 0.09375197 [Tournament: 4.042583 Model: LIGHTGBM Feature Cost: 4] 2021-08-20 01:20:21,378 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 5 transformers creating 8 total features and 8 features for model: 1.619091 RMSE 2021-08-20 01:20:21,383 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | Top 8 variable importances of best individual: 2021-08-20 01:20:21,390 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:20:21,394 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:20:21,397 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.788475 2021-08-20 01:20:21,400 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 2 2_X_2 0.296163 2021-08-20 01:20:21,403 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.295632 2021-08-20 01:20:21,406 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 4 10_InteractionAdd:X_0:X_1 0.276633 2021-08-20 01:20:21,409 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 5 10_InteractionSub:X_0:X_1 0.086895 2021-08-20 01:20:21,413 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 6 5_X_5 0.077826 2021-08-20 01:20:21,416 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 DATA | 7 10_InteractionDiv:X_0:X_1 0.031322 2021-08-20 01:20:21,421 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:20:21,424 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:20:21,427 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | Starting Iteration: 10 2021-08-20 01:20:21,430 C: 76% D:956.7GB M:227.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:20:24,723 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:20:24,751 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | Completed 180 munging tasks out of 180 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:20:25,105 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:20:25,263 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:25,652 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:25,656 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:25,669 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:25,696 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:25,699 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:25,704 C: 81% D:957.0GB M:228.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:28,003 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 2.88456 seconds. 2021-08-20 01:20:28,022 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:20:28,028 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:20:28,145 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 132 iterations: 132 2021-08-20 01:20:28,154 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.12721 seconds. 2021-08-20 01:20:28,158 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 92.4GB, since last ping: 14.3MB/s. CPU memory usage: 635.5MB, max: 895.1MB CPU: 397% Procs: 6 . GPU memory usage: 299.9MB, max: 299.9MB GPUs usage: 0% OpenFiles: 0/6291456 (OpenFilesUser: 0) PSThreads: 20 (Disk: Read: 0B/s Write: 532.0kB/s Size: 9.0MB) (Connections: 58 Fds: 275 WinHandles: 0 Threads: 20 Maps: 4000 WinOpenFiles: 0) (System-Wide CPU: User: 67% Nice: 0% System: 11% Wait: 0% DAIActiveprocs: 23 DAIprocs: 59) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_10)_score_train-training_xgb_indiv_0_fold_2] 2021-08-20 01:20:28,208 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.13637 seconds. 2021-08-20 01:20:28,412 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 3.14115 seconds. 2021-08-20 01:20:28,433 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:28,437 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:28,533 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 166 iterations: 166 2021-08-20 01:20:28,596 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.15708 seconds. 2021-08-20 01:20:28,601 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.16819 seconds. 2021-08-20 01:20:28,741 C: 87% D:956.8GB M:233.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:29,125 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) start. 2021-08-20 01:20:29,246 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:29,248 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:29,253 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:29,462 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:29,465 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:29,470 C: 81% D:956.3GB M:233.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:30,912 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 2.17016 seconds. 2021-08-20 01:20:30,932 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:30,939 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:31,083 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 119 iterations: 119 2021-08-20 01:20:31,115 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.17666 seconds. 2021-08-20 01:20:31,118 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.18683 seconds. 2021-08-20 01:20:31,340 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 14) end. Took 2.21054 seconds. 2021-08-20 01:20:31,364 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) start. 2021-08-20 01:20:31,374 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) start. 2021-08-20 01:20:31,456 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 135 iterations: 135 2021-08-20 01:20:31,465 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 14) model predict (334, 14) end. Took 0.09632 seconds. 2021-08-20 01:20:31,469 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 15) end. Took 0.10476 seconds. 2021-08-20 01:20:31,634 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:31,891 C: 87% D:956.3GB M:232.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) start. 2021-08-20 01:20:31,980 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:31,987 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:31,989 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:32,227 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:20:32,232 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:20:32,236 C: 82% D:956.3GB M:232.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:20:33,617 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 1.72849 seconds. 2021-08-20 01:20:33,630 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:33,647 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:33,740 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 121 iterations: 121 2021-08-20 01:20:33,804 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.15655 seconds. 2021-08-20 01:20:33,806 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.17536 seconds. 2021-08-20 01:20:34,147 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 14) end. Took 2.50924 seconds. 2021-08-20 01:20:34,162 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) start. 2021-08-20 01:20:34,166 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) start. 2021-08-20 01:20:34,271 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 144 iterations: 144 2021-08-20 01:20:34,278 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 14) model predict (333, 14) end. Took 0.11048 seconds. 2021-08-20 01:20:34,283 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 15) end. Took 0.11937 seconds. 2021-08-20 01:20:34,520 C: 86% D:956.6GB M:231.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:20:34,867 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:34,884 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:34,888 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:34,892 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:35,223 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:35,228 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:35,232 C: 81% D:956.5GB M:232.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:37,014 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 2.49163 seconds. 2021-08-20 01:20:37,031 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:20:37,034 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:20:37,154 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 171 iterations: 171 2021-08-20 01:20:37,204 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.16289 seconds. 2021-08-20 01:20:37,208 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.17535 seconds. 2021-08-20 01:20:37,486 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 2.61380 seconds. 2021-08-20 01:20:37,507 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:37,518 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:37,605 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 158 iterations: 158 2021-08-20 01:20:37,616 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.10453 seconds. 2021-08-20 01:20:37,620 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.11283 seconds. 2021-08-20 01:20:37,650 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 2 9 and Completed 11 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:37,845 C: 86% D:956.0GB M:231.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:38,164 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) start. 2021-08-20 01:20:38,271 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:38,275 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:38,278 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:38,579 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:38,602 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:38,606 C: 83% D:956.0GB M:230.4GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:41,762 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 11) end. Took 3.59833 seconds. 2021-08-20 01:20:41,785 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) start. 2021-08-20 01:20:41,790 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) start. 2021-08-20 01:20:41,909 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 181 iterations: 181 2021-08-20 01:20:41,967 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 11) model predict (334, 11) end. Took 0.17569 seconds. 2021-08-20 01:20:41,972 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 12) end. Took 0.18671 seconds. 2021-08-20 01:20:42,480 C: 90% D:955.9GB M:227.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:42,941 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 5.09294 seconds. 2021-08-20 01:20:42,956 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:42,959 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:43,036 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 263 iterations: 263 2021-08-20 01:20:43,047 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.08696 seconds. 2021-08-20 01:20:43,050 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.09378 seconds. 2021-08-20 01:20:43,140 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:43,144 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:43,148 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:43,652 C: 84% D:955.8GB M:226.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) start. 2021-08-20 01:20:44,031 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:44,042 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:20:44,045 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:44,597 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 2.11556 seconds. 2021-08-20 01:20:44,622 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:44,628 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:44,718 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 133 iterations: 133 2021-08-20 01:20:44,728 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.10041 seconds. 2021-08-20 01:20:44,731 C: 78% D:955.2GB M:230.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.11499 seconds. 2021-08-20 01:20:45,210 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:20:45,774 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:45,777 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:20:45,779 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:45,928 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 11) end. Took 2.27453 seconds. 2021-08-20 01:20:45,944 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) start. 2021-08-20 01:20:45,949 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) start. 2021-08-20 01:20:46,031 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 183 iterations: 183 2021-08-20 01:20:46,039 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 11) model predict (333, 11) end. Took 0.09144 seconds. 2021-08-20 01:20:46,042 C: 82% D:953.6GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 12) end. Took 0.09956 seconds. 2021-08-20 01:20:46,270 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.06243 seconds. 2021-08-20 01:20:46,281 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:20:46,284 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:20:46,359 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:46,385 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.09926 seconds. 2021-08-20 01:20:46,388 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.10589 seconds. 2021-08-20 01:20:46,472 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:46,800 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:46,942 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:46,947 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:20:46,950 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:47,087 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:47,090 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:20:47,093 C: 71% D:953.5GB M:233.3GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:47,504 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.03411 seconds. 2021-08-20 01:20:47,516 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:47,518 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:47,570 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 0.76932 seconds. 2021-08-20 01:20:47,582 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:47,584 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:47,588 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:47,598 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07835 seconds. 2021-08-20 01:20:47,601 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08473 seconds. 2021-08-20 01:20:47,650 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:47,659 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07374 seconds. 2021-08-20 01:20:47,663 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08036 seconds. 2021-08-20 01:20:48,113 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 6 fold_id= 3 16 and Completed 19 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:48,255 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:20:48,417 C: 52% D:953.3GB M:233.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:48,716 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:48,723 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:20:48,725 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:48,729 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:20:48,732 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:20:48,734 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:49,241 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 0.82341 seconds. 2021-08-20 01:20:49,254 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:49,257 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:49,267 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 1.01206 seconds. 2021-08-20 01:20:49,278 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:20:49,280 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:20:49,320 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 282 iterations: 282 2021-08-20 01:20:49,326 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.06930 seconds. 2021-08-20 01:20:49,328 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.07560 seconds. 2021-08-20 01:20:49,344 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:20:49,351 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.06982 seconds. 2021-08-20 01:20:49,353 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.07524 seconds. 2021-08-20 01:20:49,654 C: 39% D:953.1GB M:234.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:20:49,806 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:20:49,957 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:20:49,959 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:20:49,961 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:50,084 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:50,086 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708'} 2021-08-20 01:20:50,088 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:20:50,469 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 0.81371 seconds. 2021-08-20 01:20:50,481 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:20:50,484 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:20:50,559 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:20:50,567 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08205 seconds. 2021-08-20 01:20:50,569 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08786 seconds. 2021-08-20 01:20:50,678 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 0.87108 seconds. 2021-08-20 01:20:50,688 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:20:50,690 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:20:50,754 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 69 iterations: 69 2021-08-20 01:20:50,759 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.06868 seconds. 2021-08-20 01:20:50,761 C: 35% D:953.0GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.07384 seconds. 2021-08-20 01:20:50,906 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:51,096 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:51,186 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:51,190 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737'} 2021-08-20 01:20:51,193 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:20:51,358 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:51,360 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792'} 2021-08-20 01:20:51,362 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:20:51,894 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 0.79764 seconds. 2021-08-20 01:20:51,905 C: 32% D:952.8GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:51,907 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:51,927 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.02100 seconds. 2021-08-20 01:20:51,937 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:51,939 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:51,970 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:20:51,975 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.06774 seconds. 2021-08-20 01:20:51,977 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07248 seconds. 2021-08-20 01:20:52,005 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:20:52,010 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07066 seconds. 2021-08-20 01:20:52,012 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07535 seconds. 2021-08-20 01:20:52,346 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) start. 2021-08-20 01:20:52,443 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:52,613 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:52,616 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371'} 2021-08-20 01:20:52,618 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:20:52,709 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:52,711 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112'} 2021-08-20 01:20:52,713 C: 32% D:952.7GB M:234.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:20:53,239 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 5) end. Took 0.89338 seconds. 2021-08-20 01:20:53,250 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) start. 2021-08-20 01:20:53,252 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) start. 2021-08-20 01:20:53,293 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 0.84917 seconds. 2021-08-20 01:20:53,303 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:53,305 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:53,318 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 83 iterations: 83 2021-08-20 01:20:53,323 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 5) model predict (334, 5) end. Took 0.07064 seconds. 2021-08-20 01:20:53,325 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 6) end. Took 0.07519 seconds. 2021-08-20 01:20:53,376 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 69 iterations: 69 2021-08-20 01:20:53,381 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.07578 seconds. 2021-08-20 01:20:53,383 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.08058 seconds. 2021-08-20 01:20:53,724 C: 30% D:952.5GB M:233.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) start. 2021-08-20 01:20:54,274 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1} 2021-08-20 01:20:54,280 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786'} 2021-08-20 01:20:54,282 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:20:54,884 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 5) end. Took 1.16029 seconds. 2021-08-20 01:20:54,894 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) start. 2021-08-20 01:20:54,897 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) start. 2021-08-20 01:20:54,957 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 69 iterations: 69 2021-08-20 01:20:54,963 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 5) model predict (333, 5) end. Took 0.06598 seconds. 2021-08-20 01:20:54,966 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 6) end. Took 0.07122 seconds. 2021-08-20 01:20:55,151 C: 27% D:952.3GB M:238.0GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:20:57,403 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 132, model transformed features: 14, total model time: 3.407, fit model time: 3.406 2021-08-20 01:20:57,409 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 166, model transformed features: 14, total model time: 3.5887, fit model time: 3.5874 2021-08-20 01:20:57,411 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 119, model transformed features: 14, total model time: 2.7056, fit model time: 2.7043 2021-08-20 01:20:57,413 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 135, model transformed features: 14, total model time: 2.628, fit model time: 2.6262 2021-08-20 01:20:57,415 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 121, model transformed features: 14, total model time: 2.1829, fit model time: 2.1811 2021-08-20 01:20:57,417 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 144, model transformed features: 14, total model time: 2.9312, fit model time: 2.9299 2021-08-20 01:20:57,419 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 171, model transformed features: 11, total model time: 2.9582, fit model time: 2.957 2021-08-20 01:20:57,421 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 158, model transformed features: 11, total model time: 3.0162, fit model time: 3.0146 2021-08-20 01:20:57,422 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 181, model transformed features: 11, total model time: 4.1033, fit model time: 4.1021 2021-08-20 01:20:57,424 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 263, model transformed features: 11, total model time: 5.4773, fit model time: 5.4759 2021-08-20 01:20:57,426 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 133, model transformed features: 11, total model time: 2.5193, fit model time: 2.5183 2021-08-20 01:20:57,428 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 183, model transformed features: 11, total model time: 2.6667, fit model time: 2.6658 2021-08-20 01:20:57,429 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.4198, fit model time: 1.419 2021-08-20 01:20:57,431 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.3794, fit model time: 1.3783 2021-08-20 01:20:57,433 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.076, fit model time: 1.0748 2021-08-20 01:20:57,435 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 282, model transformed features: 13, total model time: 1.0856, fit model time: 1.0848 2021-08-20 01:20:57,436 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 13, total model time: 1.2933, fit model time: 1.2925 2021-08-20 01:20:57,438 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 6: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.0996, fit model time: 1.0986 2021-08-20 01:20:57,441 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 69, model transformed features: 5, total model time: 1.1676, fit model time: 1.1668 2021-08-20 01:20:57,443 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 84, model transformed features: 5, total model time: 1.0621, fit model time: 1.0612 2021-08-20 01:20:57,444 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 5, total model time: 1.3021, fit model time: 1.3013 2021-08-20 01:20:57,446 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 83, model transformed features: 5, total model time: 1.1963, fit model time: 1.1956 2021-08-20 01:20:57,448 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 69, model transformed features: 5, total model time: 1.1148, fit model time: 1.114 2021-08-20 01:20:57,450 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 7: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 69, model transformed features: 5, total model time: 1.4307, fit model time: 1.4298 2021-08-20 01:20:57,893 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.6344 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:57,934 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:57,948 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:57,989 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,047 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.6437 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,068 C: 31% D:951.9GB M:237.7GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6729 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,877 C: 29% D:951.7GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:20:58,911 C: 29% D:951.7GB M:237.0GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=2.6649 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:21:00,035 C: 22% D:951.5GB M:237.6GB NODE:LOCAL1 7646 INFO | Munge time: 0.0704 s, Train time: 30.3891 s, Score time: 2.5023 s 2021-08-20 01:21:00,470 C: 22% D:951.5GB M:237.6GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:21:01,374 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:21:01,398 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:21:01,402 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Time so far: 1931 secs 2021-08-20 01:21:01,406 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Stopping in: 84468 secs 2021-08-20 01:21:01,481 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Experiment Progress: 38.9 % 2021-08-20 01:21:01,578 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Scored 139/310 models on 28 features. Last Scored [LIGHTGBM] 2021-08-20 01:21:01,588 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Scores (RMSE, less is better): 2021-08-20 01:21:01,591 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 0 : 1.56956 +/- 0.07548585 [Tournament: 1.56956 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:21:01,593 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 1 : 1.619091 +/- 0.06072595 [Tournament: 1.619091 Model: LIGHTGBM Feature Cost: 8] 2021-08-20 01:21:01,595 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 2 : 1.634389 +/- 0.05224874 [Tournament: 1.634389 Model: LIGHTGBM Feature Cost: 16] 2021-08-20 01:21:01,597 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 3 : 1.638517 +/- 0.04910973 [Tournament: 1.638517 Model: LIGHTGBM Feature Cost: 17] 2021-08-20 01:21:01,599 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 4 : 1.643672 +/- 0.06142867 [Tournament: 1.643672 Model: LIGHTGBM Feature Cost: 14] 2021-08-20 01:21:01,601 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 5 : 1.66976 +/- 0.04171555 [Tournament: 1.66976 Model: LIGHTGBM Feature Cost: 13] 2021-08-20 01:21:01,602 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 6 : 1.672878 +/- 0.0708335 [Tournament: 1.672878 Model: LIGHTGBM Feature Cost: 11] 2021-08-20 01:21:01,604 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Individual 7 : 2.664922 +/- 0.07229169 [Tournament: 2.664922 Model: LIGHTGBM Feature Cost: 5] 2021-08-20 01:21:01,606 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Best individual with LIGHTGBM model has 10 transformers creating 13 total features and 13 features for model: 1.56956 RMSE 2021-08-20 01:21:01,608 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | Top 10 variable importances of best individual: 2021-08-20 01:21:01,613 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | LInteraction LGain 2021-08-20 01:21:01,616 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 0 3_X_3 1.000000 2021-08-20 01:21:01,619 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 1 10_InteractionMul:X_0:X_1 0.555859 2021-08-20 01:21:01,621 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 2 10_InteractionAdd:X_0:X_1 0.391387 2021-08-20 01:21:01,624 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 3 4_X_4 0.266291 2021-08-20 01:21:01,626 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 4 2_X_2 0.178320 2021-08-20 01:21:01,629 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 5 1_X_1 0.064184 2021-08-20 01:21:01,631 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 6 0_X_0 0.040219 2021-08-20 01:21:01,634 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 7 10_InteractionSub:X_0:X_1 0.032582 2021-08-20 01:21:01,637 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 8 7_X_7 0.005531 2021-08-20 01:21:01,639 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 DATA | 9 10_InteractionDiv:X_0:X_1 0.004636 2021-08-20 01:21:01,643 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | 2021-08-20 01:21:01,646 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:21:01,649 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | Starting Iteration: 11 2021-08-20 01:21:01,651 C: 17% D:951.3GB M:237.6GB NODE:LOCAL1 7646 INFO | ============================================================================ 2021-08-20 01:21:04,134 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | Engineering features (for 4/8 base individual models out of 24 total models across folds, out of population with 8 individuals). 2021-08-20 01:21:04,152 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | Completed 162 munging tasks out of 162 total tasks (including identity) for 8 indivs and 6 folds 2021-08-20 01:21:04,410 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:21:04,491 C: 30% D:950.9GB M:236.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:21:33,060 C: 48% D:948.8GB M:233.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 95.5GB, since last ping: 20.7MB/s. CPU memory usage: 623.5MB, max: 911.3MB CPU: 20% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.8kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 60% Nice: 0% System: 7% Wait: 3% DAIActiveprocs: 1 DAIprocs: 37) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:22:38,290 C: 67% D:948.0GB M:232.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 101.7GB, since last ping: 3.6MB/s. CPU memory usage: 624.8MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 57% Nice: 0% System: 8% Wait: 0% DAIActiveprocs: 1 DAIprocs: 40) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:23:43,472 C: 66% D:945.0GB M:231.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 103.1GB, since last ping: 3.3MB/s. CPU memory usage: 624.1MB, max: 911.3MB CPU: 20% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 59% Nice: 0% System: 5% Wait: 0% DAIActiveprocs: 1 DAIprocs: 34) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:24:47,989 C: 28% D:941.9GB M:236.6GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 107.9GB, since last ping: 36.0MB/s. CPU memory usage: 624.2MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.0kB/s Size: 9.0MB) (Connections: 58 Fds: 266 WinHandles: 0 Threads: 13 Maps: 3997 WinOpenFiles: 0) (System-Wide CPU: User: 48% Nice: 0% System: 6% Wait: 8% DAIActiveprocs: 1 DAIprocs: 33) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_2] 2021-08-20 01:25:14,274 C: 14% D:937.8GB M:245.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:25:14,283 C: 14% D:937.8GB M:245.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_0': '0.40875', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:25:14,285 C: 14% D:937.8GB M:245.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:25:15,357 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 250.86616 seconds. 2021-08-20 01:25:15,368 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:25:15,370 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:25:15,436 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 146 iterations: 146 2021-08-20 01:25:15,447 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07475 seconds. 2021-08-20 01:25:15,450 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08140 seconds. 2021-08-20 01:25:15,720 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 2 3 and Completed 5 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:25:15,725 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:25:15,729 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 DATA | Time: 251.466 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 5, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:25:15,733 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:25:15,737 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | Time: 251.466 s: LIGHTGBM 2021-08-20 01:25:15,867 C: 27% D:937.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:25:41,823 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:25:41,832 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_0': '0.41809', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:25:41,834 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:25:42,778 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 278.36791 seconds. 2021-08-20 01:25:42,790 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:25:42,793 C: 38% D:936.5GB M:243.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:25:42,858 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 106 iterations: 106 2021-08-20 01:25:42,864 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07015 seconds. 2021-08-20 01:25:42,866 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.07547 seconds. 2021-08-20 01:25:43,114 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 3 4 and Completed 6 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:25:43,281 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) start. 2021-08-20 01:25:43,329 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:25:43,332 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_0': '0.39619', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:25:43,335 C: 26% D:936.4GB M:242.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:25:44,885 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 29.01743 seconds. 2021-08-20 01:25:44,897 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:25:44,899 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:25:44,972 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 175 iterations: 175 2021-08-20 01:25:44,983 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.08166 seconds. 2021-08-20 01:25:44,988 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08922 seconds. 2021-08-20 01:25:45,374 C: 23% D:937.0GB M:241.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:25:56,143 C: 60% D:935.2GB M:240.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 115.3GB, since last ping: 25.5MB/s. CPU memory usage: 620.9MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 27.5kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 54% Nice: 0% System: 8% Wait: 5% DAIActiveprocs: 1 DAIprocs: 32) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_5] 2021-08-20 01:27:03,287 C: 64% D:934.5GB M:240.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 120.4GB, since last ping: 11.2MB/s. CPU memory usage: 623.0MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.4kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 59% Nice: 0% System: 5% Wait: 5% DAIActiveprocs: 1 DAIprocs: 32) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_2_fold_5] 2021-08-20 01:27:22,811 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:27:22,818 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_0': '0.38650', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:27:22,820 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:27:23,711 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 9) end. Took 100.43034 seconds. 2021-08-20 01:27:23,721 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) start. 2021-08-20 01:27:23,723 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) start. 2021-08-20 01:27:23,794 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 118 iterations: 118 2021-08-20 01:27:23,800 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 9) model predict (334, 9) end. Took 0.07685 seconds. 2021-08-20 01:27:23,802 C: 21% D:933.6GB M:242.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 10) end. Took 0.08107 seconds. 2021-08-20 01:27:24,031 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 2 fold_id= 5 6 and Completed 8 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:27:24,037 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:27:24,039 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 DATA | Time: 98.824 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 5, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 0, 1, 1, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:27:24,040 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:27:24,043 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | Time: 98.824 s: LIGHTGBM 2021-08-20 01:27:24,162 C: 25% D:933.2GB M:241.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) start. 2021-08-20 01:27:34,755 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:27:34,764 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_0': '0.43046', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:27:34,766 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:27:35,684 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 11.52193 seconds. 2021-08-20 01:27:35,694 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:27:35,697 C: 24% D:933.8GB M:244.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:27:35,761 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 102 iterations: 102 2021-08-20 01:27:35,781 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07106 seconds. 2021-08-20 01:27:35,785 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.08955 seconds. 2021-08-20 01:27:36,061 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 0 7 and Completed 9 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:27:36,111 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_0': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:27:36,113 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_0': '0.40506', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:27:36,116 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:27:36,203 C: 29% D:933.8GB M:244.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:27:37,059 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 9) end. Took 111.68573 seconds. 2021-08-20 01:27:37,072 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) start. 2021-08-20 01:27:37,074 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) start. 2021-08-20 01:27:37,140 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 107 iterations: 107 2021-08-20 01:27:37,146 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 9) model predict (333, 9) end. Took 0.07115 seconds. 2021-08-20 01:27:37,148 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 10) end. Took 0.07637 seconds. 2021-08-20 01:27:37,494 C: 34% D:933.8GB M:244.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:28:09,688 C: 49% D:930.2GB M:239.3GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 125.0GB, since last ping: 28.6MB/s. CPU memory usage: 622.8MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.0kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 63% Nice: 0% System: 5% Wait: 0% DAIActiveprocs: 2 DAIprocs: 31) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_2] 2021-08-20 01:29:04,838 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:29:04,846 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:29:04,848 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:29:05,440 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 89.23655 seconds. 2021-08-20 01:29:05,452 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:29:05,455 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:29:05,527 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 62 iterations: 62 2021-08-20 01:29:05,532 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.07688 seconds. 2021-08-20 01:29:05,534 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.08228 seconds. 2021-08-20 01:29:05,789 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 2 9 and Completed 11 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:29:05,793 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:29:05,796 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 DATA | Time: 88.457 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:29:05,799 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:29:05,802 C: 18% D:925.4GB M:244.1GB NODE:LOCAL1 7646 INFO | Time: 88.457 s: LIGHTGBM 2021-08-20 01:29:05,924 C: 25% D:925.3GB M:244.0GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:29:14,330 C: 18% D:925.2GB M:242.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 131.1GB, since last ping: 14.5MB/s. CPU memory usage: 623.4MB, max: 911.3MB CPU: 69% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 20.4kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 4% Wait: 7% DAIActiveprocs: 3 DAIprocs: 30) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:30:23,893 C: 22% D:926.1GB M:239.7GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 135.7GB, since last ping: 2.7MB/s. CPU memory usage: 623.7MB, max: 911.3MB CPU: 49% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.2kB/s Size: 9.1MB) (Connections: 58 Fds: 281 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 5% Wait: 9% DAIActiveprocs: 3 DAIprocs: 29) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:31:30,583 C: 24% D:921.7GB M:243.5GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 138.0GB, since last ping: 13.2MB/s. CPU memory usage: 624.7MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 5% Wait: 1% DAIActiveprocs: 2 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:32:38,688 C: 22% D:914.7GB M:238.8GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 144.4GB, since last ping: 13.7MB/s. CPU memory usage: 623.5MB, max: 911.3MB CPU: 69% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.3kB/s Size: 9.1MB) (Connections: 58 Fds: 282 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 6% Wait: 4% DAIActiveprocs: 3 DAIprocs: 28) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:33:45,650 C: 22% D:913.3GB M:234.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 149.4GB, since last ping: 8.5MB/s. CPU memory usage: 623.5MB, max: 911.3MB CPU: 49% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.6kB/s Size: 9.1MB) (Connections: 58 Fds: 281 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 6% Wait: 4% DAIActiveprocs: 3 DAIprocs: 30) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_3_fold_3] 2021-08-20 01:34:21,077 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:34:21,085 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:34:21,086 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:34:21,795 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 404.29980 seconds. 2021-08-20 01:34:21,808 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:34:21,810 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:34:21,884 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 89 iterations: 89 2021-08-20 01:34:21,891 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07999 seconds. 2021-08-20 01:34:21,893 C: 21% D:912.8GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08605 seconds. 2021-08-20 01:34:22,129 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 3 fold_id= 3 10 and Completed 12 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:34:22,138 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:34:22,140 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Time: 316.348 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:34:22,142 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:34:22,144 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | Time: 316.348 s: LIGHTGBM 2021-08-20 01:34:22,278 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:34:22,280 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:34:22,282 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:34:22,292 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) start. 2021-08-20 01:34:22,871 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 316.94686 seconds. 2021-08-20 01:34:22,883 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:34:22,886 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:34:22,951 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 96 iterations: 96 2021-08-20 01:34:22,957 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07088 seconds. 2021-08-20 01:34:22,959 C: 28% D:912.6GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.07637 seconds. 2021-08-20 01:34:23,238 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:34:23,246 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:34:23,248 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:34:23,289 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:34:23,837 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 6) end. Took 1.54506 seconds. 2021-08-20 01:34:23,846 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) start. 2021-08-20 01:34:23,849 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) start. 2021-08-20 01:34:23,912 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 92 iterations: 92 2021-08-20 01:34:23,917 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 6) model predict (334, 6) end. Took 0.06811 seconds. 2021-08-20 01:34:23,919 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 7) end. Took 0.07255 seconds. 2021-08-20 01:34:24,213 C: 25% D:912.7GB M:241.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) start. 2021-08-20 01:34:50,124 C: 23% D:911.3GB M:240.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 153.7GB, since last ping: 9.2MB/s. CPU memory usage: 624.0MB, max: 911.3MB CPU: 59% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.7kB/s Size: 9.1MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 17% Nice: 0% System: 4% Wait: 1% DAIActiveprocs: 1 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_0] 2021-08-20 01:35:56,067 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 158.0GB, since last ping: 18.1MB/s. CPU memory usage: 625.0MB, max: 911.3MB CPU: 29% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 21 (Disk: Read: 0B/s Write: 1.1kB/s Size: 9.1MB) (Connections: 58 Fds: 286 WinHandles: 0 Threads: 13 Maps: 4012 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 3% Wait: 7% DAIActiveprocs: 0 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_0] 2021-08-20 01:35:56,119 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:35:56,122 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:35:56,125 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:35:56,833 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 93.54276 seconds. 2021-08-20 01:35:56,852 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:35:56,856 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:35:56,938 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 76 iterations: 76 2021-08-20 01:35:56,945 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.08912 seconds. 2021-08-20 01:35:56,948 C: 18% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.09663 seconds. 2021-08-20 01:35:57,190 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 0 13 and Completed 15 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:35:57,197 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:35:57,199 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 DATA | Time: 93.1045 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 10, 'max_leaves': 1024, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.0, 'colsample_bytree': 0.7999999999999999, 'subsample': 0.7000000000000001, 'subsample_freq': 1, 'reg_lambda': 0.0, 'reg_alpha': 0.0, 'min_child_samples': 1, 'min_data_in_bin': 1, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 1024, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'DefaultIndiv: do_te:False,accuracy:7,interp:11,num_as_cat:False', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 50, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:35:57,201 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:35:57,203 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | Time: 93.1045 s: LIGHTGBM 2021-08-20 01:35:57,326 C: 23% D:904.9GB M:240.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:36:06,277 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:36:06,286 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_3': '0.58786', 'X_4': '0.37323'} 2021-08-20 01:36:06,288 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:36:06,966 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 6) end. Took 102.75454 seconds. 2021-08-20 01:36:06,978 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) start. 2021-08-20 01:36:06,981 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) start. 2021-08-20 01:36:07,053 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 84 iterations: 84 2021-08-20 01:36:07,058 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 6) model predict (333, 6) end. Took 0.07767 seconds. 2021-08-20 01:36:07,061 C: 15% D:904.8GB M:240.7GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 7) end. Took 0.08295 seconds. 2021-08-20 01:36:07,333 C: 24% D:904.7GB M:240.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 1 14 and Completed 16 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:36:07,487 C: 24% D:904.7GB M:240.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:37:00,918 C: 23% D:908.5GB M:240.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 163.4GB, since last ping: 12.9MB/s. CPU memory usage: 625.8MB, max: 911.3MB CPU: 79% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 9.1MB) (Connections: 58 Fds: 274 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 4% Wait: 2% DAIActiveprocs: 2 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:38:08,035 C: 22% D:909.3GB M:243.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 166.8GB, since last ping: 1.5MB/s. CPU memory usage: 624.3MB, max: 911.3MB CPU: 30% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.2kB/s Size: 9.1MB) (Connections: 58 Fds: 273 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 19% Nice: 0% System: 5% Wait: 0% DAIActiveprocs: 1 DAIprocs: 26) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:39:14,514 C: 23% D:903.8GB M:244.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 171.7GB, since last ping: 2.4MB/s. CPU memory usage: 625.8MB, max: 911.3MB CPU: 10% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.7kB/s Size: 9.1MB) (Connections: 58 Fds: 273 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 18% Nice: 0% System: 5% Wait: 1% DAIActiveprocs: 3 DAIprocs: 25) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:40:19,400 C: 21% D:901.2GB M:243.9GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 175.7GB, since last ping: 7.9MB/s. CPU memory usage: 623.8MB, max: 911.3MB CPU: 109% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 1.6kB/s Size: 9.1MB) (Connections: 58 Fds: 274 WinHandles: 0 Threads: 13 Maps: 4002 WinOpenFiles: 0) (System-Wide CPU: User: 15% Nice: 0% System: 4% Wait: 1% DAIActiveprocs: 2 DAIprocs: 25) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_2] 2021-08-20 01:41:21,066 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:41:21,072 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.41809', 'InteractionAdd:X_0:X_1': '0.54035', 'InteractionMul:X_0:X_1': '0.50024', 'X_1': '0.36014', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:41:21,074 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11806'} 2021-08-20 01:41:21,557 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 324.23117 seconds. 2021-08-20 01:41:21,568 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:41:21,571 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:41:21,638 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:41:21,644 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.07327 seconds. 2021-08-20 01:41:21,647 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.07849 seconds. 2021-08-20 01:41:21,908 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 2 15 and Completed 17 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:41:21,912 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:41:21,914 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Time: 314.584 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 0.0, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:41:21,917 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:41:21,919 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | Time: 314.584 s: LIGHTGBM 2021-08-20 01:41:22,014 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:41:22,017 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40875', 'InteractionAdd:X_0:X_1': '0.54529', 'InteractionMul:X_0:X_1': '0.50019', 'X_1': '0.37831', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:41:22,019 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10035'} 2021-08-20 01:41:22,054 C: 24% D:900.0GB M:244.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:41:22,559 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 315.07212 seconds. 2021-08-20 01:41:22,571 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:41:22,573 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:41:22,642 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:41:22,653 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07738 seconds. 2021-08-20 01:41:22,656 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08484 seconds. 2021-08-20 01:41:22,999 C: 28% D:900.0GB M:244.5GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) start. 2021-08-20 01:41:25,259 C: 24% D:900.0GB M:244.1GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 178.8GB, since last ping: 2.6MB/s. CPU memory usage: 622.6MB, max: 911.3MB CPU: 119% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 21 (Disk: Read: 0B/s Write: 33.1kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 7% Wait: 0% DAIActiveprocs: 2 DAIprocs: 25) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_4] 2021-08-20 01:42:31,045 C: 21% D:938.7GB M:247.4GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 180.9GB, since last ping: 191.4kB/s. CPU memory usage: 624.3MB, max: 911.3MB CPU: 0% Procs: 5 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/5242880 (OpenFilesUser: 0) PSThreads: 18 (Disk: Read: 0B/s Write: 2.6kB/s Size: 9.1MB) (Connections: 58 Fds: 280 WinHandles: 0 Threads: 13 Maps: 4007 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 6% Wait: 1% DAIActiveprocs: 2 DAIprocs: 28) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_EvolutionAutoDL_feature_engineering_(iteration_11)_score_train-training_xgb_indiv_4_fold_4] 2021-08-20 01:43:17,856 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:17,861 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.38650', 'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'X_1': '0.37401', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:43:17,863 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.11081'} 2021-08-20 01:43:18,321 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 13) end. Took 115.32185 seconds. 2021-08-20 01:43:18,333 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) start. 2021-08-20 01:43:18,335 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) start. 2021-08-20 01:43:18,436 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 297 iterations: 297 2021-08-20 01:43:18,446 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 13) model predict (334, 13) end. Took 0.10915 seconds. 2021-08-20 01:43:18,450 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 14) end. Took 0.11598 seconds. 2021-08-20 01:43:18,724 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 4 fold_id= 4 17 and Completed 19 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:18,727 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Still working on GA training 2021-08-20 01:43:18,730 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Time: 116.823 s: LIGHTGBM Parameters: {'num_classes': 1, 'num_class': 1, 'booster': 'lightgbm', 'seed': 1037348886, 'disable_gpus': False, 'n_gpus': 1, 'score_f_name': 'RMSE', 'labels': None, 'label_counts': None, '_build_info': {'commit': '4d0fa39', 'version': '1.10.0'}, 'model_class_name': 'LightGBMModel', 'gpu_id': 0, 'n_jobs': 4, 'random_state': 1037348886, 'time_column': None, 'encoder': None, 'tgc': None, 'pred_gap': None, 'pred_periods': None, 'target': None, 'ufapt': None, 'tsp': None, 'boosting_type': 'gbdt', 'enable_early_stopping_rounds': True, 'learning_rate': 0.049999999999999996, 'grow_policy': 'lossguide', 'max_depth': 24, 'max_leaves': 16, 'max_bin': 64, 'scale_pos_weight': 1.0, 'max_delta_step': 0.0, 'gamma': 0.001, 'colsample_bytree': 0.5499999999999999, 'subsample': 0.7999999999999999, 'subsample_freq': 20, 'reg_lambda': 0.0, 'reg_alpha': 10.0, 'min_child_samples': 50, 'min_data_in_bin': 10, 'min_child_weight': 0.001, 'min_split_gain': 0.0, 'subsample_for_bin': 200000, 'class_weight': None, 'monotonicity_constraints': True, 'objective': 'mse', 'eval_metric': 'rmse', 'early_stopping_rounds': 30, 'n_estimators': 300, 'importance_type': 'gain', 'num_leaves': 16, 'feature_fraction_seed': 1037348887, 'bagging_seed': 1037348888, 'num_threads': 4, 'device_type': 'cpu', 'gpu_device_id': 0, 'gpu_platform_id': 0, 'gpu_use_dp': False, 'verbose': -1, 'lossguide': False, 'silent': True, 'accuracy': 7, 'time_tolerance': 2, 'interpretability': 8, 'ensemble_level': 1, 'train_shape': (1000, 11), 'valid_shape': None, 'model_origin': 'RANDOM', 'optuna_trial': None, 'optuna_trial_state': None, 'resumed_experiment_id': '', 'str_uuid': 'ret_b97a3cbb-f99d-414f-aa44-cddc62776504', 'experiment_description': 'buvobamu', 'train_dataset_name': 'Friedman1-results.csv', 'valid_data_name': '[Valid]', 'test_data_name': None, 'outer_trial': (1, 2), 'ngenes': 10, 'ngenes_max': 100, 'uses_gpu': True, 'early_stopping_threshold': None, 'early_stopping_limit': None, 'monotone_constraints': [1, 1, -1, 1, 0, 1, 0, 1, 1, 0, 0, 0, 0], 'monotone_penalty': 0.0, 'categorical_feature': '', 'monotone_constraints_method': 'intermediate', 'IS_EVOLUTION': True} 2021-08-20 01:43:18,733 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Still working on GA training 2021-08-20 01:43:18,735 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 INFO | Time: 116.823 s: LIGHTGBM 2021-08-20 01:43:18,757 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:18,759 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.39619', 'InteractionAdd:X_0:X_1': '0.50377', 'InteractionMul:X_0:X_1': '0.47105', 'X_1': '0.33556', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:43:18,761 C: 26% D:942.4GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10140'} 2021-08-20 01:43:18,897 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:43:19,231 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 117.17830 seconds. 2021-08-20 01:43:19,252 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:43:19,256 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:43:19,332 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:19,341 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.08591 seconds. 2021-08-20 01:43:19,343 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.09297 seconds. 2021-08-20 01:43:19,676 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:19,678 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.40506', 'InteractionAdd:X_0:X_1': '0.53473', 'InteractionMul:X_0:X_1': '0.49996', 'X_1': '0.35415', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:43:19,680 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10236'} 2021-08-20 01:43:19,711 C: 20% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) start. 2021-08-20 01:43:20,114 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.21740 seconds. 2021-08-20 01:43:20,128 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:43:20,131 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:43:20,204 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 282 iterations: 282 2021-08-20 01:43:20,211 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07997 seconds. 2021-08-20 01:43:20,213 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08555 seconds. 2021-08-20 01:43:20,553 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'X_0': 1, 'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_1': -1, 'InteractionMul:X_0:X_1': 1, 'X_1': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:43:20,555 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'X_0': '0.43046', 'InteractionAdd:X_0:X_1': '0.53151', 'InteractionMul:X_0:X_1': '0.48150', 'X_1': '0.34500', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:43:20,557 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {'InteractionDiv:X_0:X_1': '-0.10351'} 2021-08-20 01:43:20,582 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) start. 2021-08-20 01:43:21,037 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 13) end. Took 1.32579 seconds. 2021-08-20 01:43:21,047 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) start. 2021-08-20 01:43:21,049 C: 21% D:942.4GB M:248.2GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) start. 2021-08-20 01:43:21,120 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 300 iterations: 300 2021-08-20 01:43:21,127 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 13) model predict (333, 13) end. Took 0.07701 seconds. 2021-08-20 01:43:21,130 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 14) end. Took 0.08236 seconds. 2021-08-20 01:43:21,472 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:21,497 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:21,500 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54035', 'InteractionAdd:X_1:X_2': '0.28236', 'InteractionMul:X_0:X_1': '0.50024', 'X_3': '0.56708', 'X_4': '0.32804'} 2021-08-20 01:43:21,503 C: 20% D:942.3GB M:248.1GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:22,866 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) end. Took 2.28410 seconds. 2021-08-20 01:43:22,878 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) start. 2021-08-20 01:43:22,880 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) start. 2021-08-20 01:43:22,946 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 128 iterations: 128 2021-08-20 01:43:22,954 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) end. Took 0.07360 seconds. 2021-08-20 01:43:22,955 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) end. Took 0.07838 seconds. 2021-08-20 01:43:23,279 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:23,384 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:23,386 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.54529', 'InteractionAdd:X_1:X_2': '0.26972', 'InteractionMul:X_0:X_1': '0.50019', 'X_3': '0.58737', 'X_4': '0.33759'} 2021-08-20 01:43:23,389 C: 23% D:942.3GB M:248.6GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:25,229 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 3.75322 seconds. 2021-08-20 01:43:25,243 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:25,246 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:25,316 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 181 iterations: 181 2021-08-20 01:43:25,329 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.08152 seconds. 2021-08-20 01:43:25,332 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08845 seconds. 2021-08-20 01:43:25,676 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionDiv:X_0:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:25,679 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.50377', 'InteractionDiv:X_0:X_2': '0.10751', 'InteractionMul:X_0:X_1': '0.47105', 'InteractionSub:X_1:X_2': '0.24084', 'X_3': '0.60792', 'X_4': '0.35375'} 2021-08-20 01:43:25,681 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:25,719 C: 21% D:942.3GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) start. 2021-08-20 01:43:26,894 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 3.61327 seconds. 2021-08-20 01:43:26,906 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:26,909 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:26,984 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 130 iterations: 130 2021-08-20 01:43:26,992 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.08237 seconds. 2021-08-20 01:43:26,994 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08799 seconds. 2021-08-20 01:43:27,375 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:27,881 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionSub:X_1:X_2': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:27,885 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.52254', 'InteractionMul:X_0:X_1': '0.48946', 'InteractionSub:X_1:X_2': '0.28763', 'X_3': '0.60371', 'X_4': '0.32524'} 2021-08-20 01:43:27,888 C: 20% D:942.2GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:28,973 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (666, 12) end. Took 3.25070 seconds. 2021-08-20 01:43:28,988 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) start. 2021-08-20 01:43:28,991 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) start. 2021-08-20 01:43:29,074 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 110 iterations: 110 2021-08-20 01:43:29,084 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (334, 12) model predict (334, 12) end. Took 0.09142 seconds. 2021-08-20 01:43:29,087 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (334, 13) end. Took 0.09886 seconds. 2021-08-20 01:43:29,334 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | Submitted indiv_id= 5 fold_id= 5 24 and Completed 26 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:29,427 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'X_3': 1, 'X_4': 1} 2021-08-20 01:43:29,431 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53473', 'InteractionAdd:X_1:X_2': '0.27238', 'InteractionMul:X_0:X_1': '0.49996', 'X_3': '0.57112', 'X_4': '0.32042'} 2021-08-20 01:43:29,434 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:29,507 C: 18% D:943.5GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) start. 2021-08-20 01:43:30,628 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 3.25165 seconds. 2021-08-20 01:43:30,642 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:30,645 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:30,717 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 116 iterations: 116 2021-08-20 01:43:30,724 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.07892 seconds. 2021-08-20 01:43:30,726 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08465 seconds. 2021-08-20 01:43:31,057 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Monotonicity constraints (direction): {'InteractionAdd:X_0:X_1': 1, 'InteractionAdd:X_1:X_2': 1, 'InteractionDiv:X_1:X_2': 1, 'InteractionMul:X_0:X_1': 1, 'InteractionMul:X_1:X_2': 1, 'X_3': 1, 'X_4': 1, 'X_7': 1} 2021-08-20 01:43:31,060 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Positive monotonicity constraints (large positive correlation with target): {'InteractionAdd:X_0:X_1': '0.53151', 'InteractionAdd:X_1:X_2': '0.26943', 'InteractionDiv:X_1:X_2': '0.10035', 'InteractionMul:X_0:X_1': '0.48150', 'InteractionMul:X_1:X_2': '0.26321', 'X_3': '0.58786', 'X_4': '0.37323', 'X_7': '0.10193'} 2021-08-20 01:43:31,063 C: 18% D:943.4GB M:248.8GB NODE:LOCAL1 7646 DATA | Negative monotonicity constraints (large negative correlation with target): {} 2021-08-20 01:43:31,952 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model fit (667, 12) end. Took 2.44502 seconds. 2021-08-20 01:43:31,964 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) start. 2021-08-20 01:43:31,967 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) start. 2021-08-20 01:43:32,037 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] Number of trees: 88 iterations: 88 2021-08-20 01:43:32,043 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] (333, 12) model predict (333, 12) end. Took 0.07540 seconds. 2021-08-20 01:43:32,045 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | [LIGHTGBM] model predict_with_transform (333, 13) end. Took 0.08079 seconds. 2021-08-20 01:43:32,224 C: 18% D:943.4GB M:248.9GB NODE:LOCAL1 7646 INFO | Completed 28 training tasks out of 24 total tasks for 8 indivs and 6 folds 2021-08-20 01:43:34,231 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 146, model transformed features: 9, total model time: 251.15, fit model time: 251.15 2021-08-20 01:43:34,240 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 106, model transformed features: 9, total model time: 278.68, fit model time: 278.67 2021-08-20 01:43:34,242 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 175, model transformed features: 9, total model time: 29.353, fit model time: 29.352 2021-08-20 01:43:34,244 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 118, model transformed features: 9, total model time: 100.74, fit model time: 100.74 2021-08-20 01:43:34,246 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 102, model transformed features: 9, total model time: 11.838, fit model time: 11.837 2021-08-20 01:43:34,248 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 107, model transformed features: 9, total model time: 111.99, fit model time: 111.99 2021-08-20 01:43:34,250 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 62, model transformed features: 6, total model time: 89.533, fit model time: 89.532 2021-08-20 01:43:34,252 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 89, model transformed features: 6, total model time: 404.61, fit model time: 404.61 2021-08-20 01:43:34,254 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 96, model transformed features: 6, total model time: 317.23, fit model time: 317.23 2021-08-20 01:43:34,256 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 92, model transformed features: 6, total model time: 1.8405, fit model time: 1.8397 2021-08-20 01:43:34,258 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 76, model transformed features: 6, total model time: 93.855, fit model time: 93.854 2021-08-20 01:43:34,260 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: False, num_as_cat: False, interpretability: 8, model iterations: 84, model transformed features: 6, total model time: 103.03, fit model time: 103.03 2021-08-20 01:43:34,262 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 324.52, fit model time: 324.52 2021-08-20 01:43:34,264 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 315.38, fit model time: 315.38 2021-08-20 01:43:34,266 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 297, model transformed features: 13, total model time: 115.67, fit model time: 115.67 2021-08-20 01:43:34,268 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 117.49, fit model time: 117.49 2021-08-20 01:43:34,269 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 282, model transformed features: 13, total model time: 1.543, fit model time: 1.5421 2021-08-20 01:43:34,271 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: True, interpretability: 8, model iterations: 300, model transformed features: 13, total model time: 1.6259, fit model time: 1.625 2021-08-20 01:43:34,273 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 0, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 128, model transformed features: 12, total model time: 2.5919, fit model time: 2.591 2021-08-20 01:43:34,275 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 1, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 181, model transformed features: 12, total model time: 4.0555, fit model time: 4.0546 2021-08-20 01:43:34,277 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 2, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 130, model transformed features: 12, total model time: 3.9001, fit model time: 3.899 2021-08-20 01:43:34,279 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 3, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 110, model transformed features: 12, total model time: 3.6019, fit model time: 3.6009 2021-08-20 01:43:34,281 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 4, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 116, model transformed features: 12, total model time: 3.5585, fit model time: 3.5575 2021-08-20 01:43:34,282 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Fold_id: 5, Just Scored: True, model name: LIGHTGBM, do_te: True, num_as_cat: False, interpretability: 8, model iterations: 88, model transformed features: 12, total model time: 2.7721, fit model time: 2.7713 2021-08-20 01:43:34,769 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 0: Layer: 0 RMSE=1.5696 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,811 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 1: Layer: 0 RMSE=1.6385 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,862 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 2: Layer: 0 RMSE=1.6172 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,897 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 3: Layer: 0 RMSE=2.0596 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,938 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 4: Layer: 0 RMSE=1.5698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:34,971 C: 19% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 5: Layer: 0 RMSE=1.6467 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:35,852 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 6: Layer: 0 RMSE=1.6698 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:35,879 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Individual 7: Layer: 0 RMSE=1.6191 LIGHTGBM ['InteractionsTransformer', 'OriginalTransformer'] 2021-08-20 01:43:36,571 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Munge time: 0.0447 s, Train time: 1348.0671 s, Score time: 2.2880 s 2021-08-20 01:43:36,997 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best individual pickle /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_individual.pickle 2021-08-20 01:43:37,128 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Ping from experiment 59939c96-0150-11ec-a7e1-0242c0a8fe02. Data written: 182.3GB, since last ping: 12.9MB/s. CPU memory usage: 696.5MB, max: 911.3MB CPU: 39% Procs: 3 . GPU memory usage: 0B, max: 299.9MB GPUs usage: 0% OpenFiles: 0/3145728 (OpenFilesUser: 0) PSThreads: 24 (Disk: Read: 0B/s Write: 341.1kB/s Size: 9.1MB) (Connections: 47 Fds: 271 WinHandles: 0 Threads: 17 Maps: 3229 WinOpenFiles: 0) (System-Wide CPU: User: 16% Nice: 0% System: 4% Wait: 1% DAIActiveprocs: 1 DAIprocs: 23) . [#h2oai-59939c96-0150-11ec-a7e1-0242c0a8fe02_a7d38823-auto_dl:_Feature_Evolution] 2021-08-20 01:43:37,373 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Exporting best population for model-feature caching to /opt/h2oai/dai/tmp/n/h2oai_experiment_59939c96-0150-11ec-a7e1-0242c0a8fe02/best_population.pickle 2021-08-20 01:43:37,386 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Time budget: 86400 secs 2021-08-20 01:43:37,388 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Time so far: 3287 secs 2021-08-20 01:43:37,391 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Stopping in: 83112 secs 2021-08-20 01:43:37,445 C: 16% D:943.3GB M:249.0GB NODE:LOCAL1 7646 INFO | Experiment Progress: 45.6 % 2021-08-20 01:43:37,526 C: 16% D:943.3GB M: