chessforyou Bettina&Terry77
chessforyou Bettina&Terry77
chessforyou Bettina&Terry77
Would you like to react to this message? Create an account in a few clicks or log in to continue.

chessforyou Bettina&Terry77


 
HomeLatest imagesRegisterLog in
WELCOME TO FORUM OF Angels77 * named in memory of Bettina & Terry
Search
 
 

Display results as :
 
Rechercher Advanced Search
Search
 
 

Display results as :
 
Rechercher Advanced Search
Latest topics
» Latest abrok Development Version March 26th (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyToday at 6:19 pm by LondonFrau

» Latest abrok Development Version March 22nd (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 24, 2024 7:05 pm by LondonFrau

» 1337 pro ctg update
Honey-XI and related now with Large Pages Enabled (LP) EmptyThu Mar 21, 2024 8:44 am by Guest

» Latest abrok Development Version March 20th (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyWed Mar 20, 2024 5:45 pm by LondonFrau

» 26 plus elo increase ..Latest SF from Abrok March 14th The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 17, 2024 1:41 pm by LondonFrau

» Latest SF from Abrok March 7th
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 10, 2024 5:52 pm by LondonFrau

» Stockfish 16.1
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 03, 2024 2:33 am by LondonFrau

»  Update default main net to nn-b1a57edbea57.nnue Febuary 17th (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyTue Feb 20, 2024 2:41 am by LondonFrau

» Latest abrok Development Version Febuary 3rd (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyWed Feb 07, 2024 9:19 am by LondonFrau

Latest topics
» Latest abrok Development Version March 26th (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyToday at 6:19 pm by LondonFrau

» Latest abrok Development Version March 22nd (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 24, 2024 7:05 pm by LondonFrau

» 1337 pro ctg update
Honey-XI and related now with Large Pages Enabled (LP) EmptyThu Mar 21, 2024 8:44 am by Guest

» Latest abrok Development Version March 20th (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyWed Mar 20, 2024 5:45 pm by LondonFrau

» 26 plus elo increase ..Latest SF from Abrok March 14th The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 17, 2024 1:41 pm by LondonFrau

» Latest SF from Abrok March 7th
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 10, 2024 5:52 pm by LondonFrau

» Stockfish 16.1
Honey-XI and related now with Large Pages Enabled (LP) EmptySun Mar 03, 2024 2:33 am by LondonFrau

»  Update default main net to nn-b1a57edbea57.nnue Febuary 17th (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyTue Feb 20, 2024 2:41 am by LondonFrau

» Latest abrok Development Version Febuary 3rd (SF The gift that keeps on giving
Honey-XI and related now with Large Pages Enabled (LP) EmptyWed Feb 07, 2024 9:19 am by LondonFrau

Navigation
 Portal
 Index
 Memberlist
 Profile
 FAQ
 Search
Navigation
 Portal
 Index
 Memberlist
 Profile
 FAQ
 Search
Forum
Forum
Affiliates
free forum
 


Affiliates
free forum
 



 

 Honey-XI and related now with Large Pages Enabled (LP)

Go down 
AuthorMessage
Belladonna
Dark Angels
Belladonna


Female Posts : 585
Reputation : 2460
Join date : 2010-07-11
Location : The covers (Bettina & Terry ) of this book (forum) are too far apart. ~ Ambrose Bierce

Honey-XI and related now with Large Pages Enabled (LP) Empty
PostSubject: Honey-XI and related now with Large Pages Enabled (LP)   Honey-XI and related now with Large Pages Enabled (LP) EmptyFri Feb 14, 2020 2:25 pm

Large Pages code ported from Brainfish by Thomas Zipproth

Both for Windows Popcnt and Bmi2
All 10 engines in the Honey family were enabled with Large Pages, including the functional equivalent Stockfish, Black-Diamond, Bluefish and Weakfish

Some runs
3970x - Windows 10 Pro

Before LP:
Stockfish-XI
bench 2048 64 26
===========================
Total time (ms) : 40053
Nodes searched : 3825860217
Nodes/second : 95519941

After LP
Stockfish-XI-LP
bench 2048 64 26
===========================
Total time (ms) : 40486
Nodes searched : 4186128286
Nodes/second : 103396934

Before LP:
Honey-XI
bench 2048 64 26
===========================
Total time (ms) : 42417
Nodes searched : 4031868048
Nodes/second : 95053116

After LP
Honey-XI-LP
bench 2048 64 26
===========================
Total time (ms) : 42289
Nodes searched : 4353576891
Nodes/second : 102948210

Before LP:
Weakfish-XI
bench 2048 64 14

===========================
Total time (ms) : 151909
Nodes searched : 18787154052
Nodes/second : 123673739

After LP:
Weakfish-XI-LP
bench 2048 64 14
===========================
Total time (ms) : 137214
Nodes searched : 18347938746
Nodes/second : 133717687

This what it will look like when running from the terminal, "b" is a shortcut for bench. You will see feedback when Large pages are enabled. No feedback means they are not enabled.
Code: [You must be registered and logged in to see this link.]
Code:
# Stockfish-XI-LP b 2048 64 26 >/dev/null
info string Hash LargePages 16 Mb  >> feedback
info string Hash LargePages 2048 Mb >> the switch to 2048M for the bench

Position: 1/46
Nodes/Second: 90057k

Position: 2/46
Nodes/Second: 96955k

Position: 3/46
Nodes/Second: 149867k

Position: 4/46
Nodes/Second: 107021k

Position: 5/46
Nodes/Second: 96096k

Position: 6/46
Nodes/Second: 97556k

Position: 7/46
Nodes/Second: 102131k

Position: 8/46
Nodes/Second: 105759k

Position: 9/46
Nodes/Second: 94619k

Position: 10/46
Nodes/Second: 110949k

Position: 11/46
Nodes/Second: 92430k

Position: 12/46
Nodes/Second: 92261k

Position: 13/46
Nodes/Second: 106225k

Position: 14/46
Nodes/Second: 95441k

Position: 15/46
Nodes/Second: 111919k

Position: 16/46
Nodes/Second: 117256k

Position: 17/46
Nodes/Second: 131569k

Position: 18/46
Nodes/Second: 169362k

Position: 19/46
Nodes/Second: 168165k

Position: 20/46
Nodes/Second: 148695k

Position: 21/46
Nodes/Second: 201570k

Position: 22/46
Nodes/Second: 198146k

Position: 23/46
Nodes/Second: 223107k

Position: 24/46
Nodes/Second: 145669k

Position: 25/46
Nodes/Second: 183492k

Position: 26/46
Nodes/Second: 137464k

Position: 27/46
Nodes/Second: 144809k

Position: 28/46
Nodes/Second: 121770k

Position: 29/46
Nodes/Second: 120945k

Position: 30/46
Nodes/Second: 152202k

Position: 31/46
Nodes/Second: 114101k

Position: 32/46
Nodes/Second: 103902k

Position: 33/46
Nodes/Second: 96549k

Position: 34/46
Nodes/Second: 97917k

Position: 35/46
Nodes/Second: 172706k

Position: 36/46
Nodes/Second: 169495k

Position: 37/46
Nodes/Second: 151874k

Position: 38/46
Nodes/Second: 150158k

Position: 39/46
Nodes/Second: 153048k

Position: 40/46
Nodes/Second: 170206k

Position: 41/46
Nodes/Second: 136215k

Position: 42/46
Nodes/Second: 91093k

Position: 43/46
Nodes/Second: 71358k

Position: 44/46
Nodes/Second: 0k

Position: 45/46
Nodes/Second: 0k

Position: 46/46
Nodes/Second: 86456k

===========================
Total time (ms) : 77074
Nodes searched  : 8073053897
Nodes/second    : 104744192

Also , it does seem to me much more efficient, when you set the memory to 2048 or a multiple of 2048. e.g.

# Stockfish-XI-LP b 24000 64 26
Stockfish XI-LP by T. Romstad, M. Costalba, J. Kiiski, G. Linscott
info string Hash LargePages 16 Mb
info string Hash LargePages 24000 Mb

===========================
Total time (ms) : 81096
Nodes searched : 8352466673
Nodes/second : 102994804

versus:

# Stockfish-XI-LP b  32768 64 26 >/dev/null
info string Hash LargePages 16 Mb
info string Hash LargePages 32768 Mb
===========================
Total time (ms) : 72008
Nodes searched : 7581919305
Nodes/second : 105292735

Enjoy!
[You must be registered and logged in to see this link.] 4.6 MB
[You must be registered and logged in to see this link.] 4.6 MB
[You must be registered and logged in to see this link.] 3.58 MB
[You must be registered and logged in to see this link.] 13.8 MB
[You must be registered and logged in to see this link.] 5.06 MB
[You must be registered and logged in to see this link.] 1.71 MB
[You must be registered and logged in to see this link.] 9.52 MB
[You must be registered and logged in to see this link.]

To Enable Large Pages in Windows 10 Pro ( admin account required)

PLEASE UNDERSTAND THE RISKS BEFORE YOU DO THIS - enabling Large Pages can slow your system to CRAWL if you have insufficient memory. I would recommend at least 128 GB of RAM. I assume no responsibility for any action you take. At the minimum, I would divide the RAM you have by 4 and use that as your max hash for all engines running. It's probably best to reboot your machine if you re planning to use a big hash ( 25% of your RAM) relative to the memory you have

  • On the Start menu, click Run. In the Open box, type gpedit.msc.

    On the Local Group Policy Editor console, expand Computer Configuration, and then expand Windows Settings.

    Expand Security Settings, and then expand Local Policies.

    Select the User Rights Assignment folder.

    The policies will be displayed in the details pane.

    In the pane, double-click Lock pages in memory.

    In the Local Security Setting - Lock pages in memory dialog box, click Add User or Group.
  • For those that may be interested, I just pushed the changes to build Honey and related binaries with large pages to Github.

    [You must be registered and logged in to see this link.] ... c5c123a3b7

    You have to set largepages to 'yes' , in the makefile. There is threadripper flag that sets the cache parameter to the 3970x. You may want to change to match your CPU.

    Build.sh builds all 10 PGO binaires on both my Mac and Threadripper box your mileage may vary. Just few items need to be changed between OS.
    It requires a fairly compliant UNIX shell under the hood. For that functionality under windows , you need to install MYSYS2 and a few other items. IT also requires setting paths in the environment. It's not for everyone. Google is your friend if you get stuck

For those that like bleeding edge binaries :

[You must be registered and logged in to see this link.] ... es/Windows

also includes base x64 , which should run on the early 64 bit windows machines which do not have popcnt or sse4.2 .

These development binaries have the 25 commits since Stockfish 11 ( really 20, since 5 were reverted) .

All versions are enabled for Large Pages - which is on by default, but can be turned off in the uci settings.
Back to top Go down
 
Honey-XI and related now with Large Pages Enabled (LP)
Back to top 
Page 1 of 1

Permissions in this forum:You cannot reply to topics in this forum
chessforyou Bettina&Terry77 :: ENGlNES :: ALL ENGlNES :: ENGlNES & CODES :: Stockfish :: StockFish Forks-
Jump to: