| A heart made clean by Thy rich blood | 422 Burdette |
| All things were made by Him | 553 Anthem on the Beginning |
| And by his men of war? | 101b Holy City |
| And conquer or die by the American Star. | 346 The American Star |
| And guides them safely by His word | 99 Gospel Trumpet |
| And I hope, by Thy good pleasure | 135 Olney 154 Rest For the Weary |
| And Jesus by redeeming blood | 99 Gospel Trumpet |
| And leads by streams that never die. | 558 Living Streams |
| And now the poor by Him redeemed | 322 Man’s Redemption |
| And pensively stood by his tomb. | 341 The Lone Pilgrim |
| And said to me as He passed by | 484 Heavenly Union |
| And sail by faith upon that flood | 99 Gospel Trumpet |
| And tell the world I’m saved by grace | 482 Mulberry Grove |
| And the world was made by Him. | 553 Anthem on the Beginning |
| And thousands by faith are now climbing it still. | 551 Jacob’s Vision |
| As warmed by the hearts of the family band | 165 Family Bible |
| Be unto the earth by reason of the trumpet | 250 Heavenly Vision |
| Because conferred by Thee. | 143 Pleyel’s Hymn |
| Bleeding hearts defiled by sin | 497 Natick |
| Built by the God of love. | 101b Holy City |
| But we arise by grace divine | 47t Primrose |
| By and by. | 35 Saints Bound For Heaven |
| By Babel’s streams we sat and wept | 126 Babel’s Streams |
| By faith its delights I explore | 449 Fatherland |
| By faith we know a world above | 206 Christian’s Hope |
| By fleeting time or conqu’ring death | 204 Mission 404 Youth Will Soon Be Gone 436 Morning Sun |
| By love dissolved away! | 67 Columbus |
| By my complaint is bitter now | 67 Columbus |
| By the cross are satisfied | 532 Peace and Joy |
| By the prophet Esaias, saying | 232 Baptismal Anthem |
| By the roes, and by the hinds of the field | 254 Rose of Sharon |
| By the Son of God was wrought | 322 Man’s Redemption |
| By the Spirit stroke for its evil deeds | 41 Home in Heaven |
| By this are sinners snatched from hell | 569t Emmaus |
| By Thy resistless grace | 354t Lebanon |
| By which we are directed | 115 Edmonds |
| By yonder shining star. | 461 Shining Star |
| Caused by my blinded eyes to see | 491 Oh, What Love |
| Close seated by my Savior’s side. | 170 Exhilaration |
| Come lay your carnal weapons by | 404 Youth Will Soon Be Gone |
| Contemned by haughty Herod | 101b Holy City |
| E’er since by faith I saw the stream | 397 The Fountain |
| Ev’ry burden to lay by | 448b The Grieved Soul |
| For Jesus will stand by you | 157 Essay |
| For mercy by day and for safety at night. | 165 Family Bible |
| Gently lead us by the hand | 510 Corley |
| Hail Him who saves you by His grace | 63 Coronation 314 Cleburne |
| He formed us by His word. | 34b St. Thomas 169 Dartmouth |
| He guides me day by day | 490 My Shepherd Guides |
| He saw me ruined by the fall | 424 Sweet Union |
| Hither, by Thy help, I’m come | 135 Olney 154 Rest For the Weary |
| Impelled by His love. | 109 Carnsville |
| Informed by the gospel for such there is room | 496 The Rock That is Higher Than I |
| It is by little steps we move | 207 Louisiana |
| Kept by a Father’s hand, love cannot die | 354b Happy Land |
| Lord, prepare us by Thy grace | 523 Pleyel’s Hymn |
| Moreover, by them is Thy servant warned. | 518 Heavenly Anthem |
| My comfort by day and my song in the night | 571 Penitence |
| No burning heats by day | 216 Delight |
| None richer possessed by the angels above | 125 Expression |
| Nor tread the rough paths of the world by thy side | 158 Funeral Thought |
| Oh can I yet be saved by grace? | 482 Mulberry Grove |
| Oh Lord, give me strength by day | 531 Dura |
| Oh Lord, prevent it by Thy grace | 96 Few Happy Matches |
| Oh may my heart, by grace renewed | 205 Pleasant Hill |
| Others by Thy grace are saved | 56b Villulia |
| “Others by Thy Word are saved | 52b Charlestown 458 Friendship |
| Peace He brings you by His death | 108t Weeping Sinners |
| Praise Him by whose almighty word | 394 The Messiah’s Praise |
| Rise, brethren, rise, your souls by faith ascending | 167 Pray, Brethren, Pray |
| Saints by the pow’r of God are kept | 500 Living Hope |
| Sat down by proud Euphrates’ stream: | 504 Wood Street |
| See, He lays His glory by | 81b Cookham |
| Straight he saw, and, won by kindness | 56b Villulia |
| Sung by flaming tongues above | 135 Olney 312b Restoration 333 Family Circle |
| Supported by His power | 109 Carnsville |
| Supported by Thy Word. | 57 Christian Soldier 513 Joyful |
| The time is soon coming, by the prophets foretold | 130 Millennium |
| Though by begging used to live | 56b Villulia |
| Though now divided by the stream | 285t Arnold |
| Though sundered far, by faith they meet | 470 The Mercy Seat |
| Through ev’ry land, by ev’ry tongue. | 192 Schenectady 276 Bridgewater 377 Eternal Praise |
| ’Tis by Thy strength the mountains stand | 344 Rainbow |
| ’Tis He, by His almighty grace | 418 Reese |
| To guard my head by night or noon. | 216 Delight |
| To see her by his side | 115 Edmonds |
| To us the high boon, by the gods has been granted | 346 The American Star |
| Unmeasured by the flight of years | 499 At Rest |
| Unpierced by human thought | 47b Idumea |
| Upheld by my righteous, omnipotent hand. | 72b Bellevue |
| Waked by the trumpet sound | 47b Idumea 428 World Unknown |
| Was called by death’s cold hand away. | 37t Ester |
| Was rejected by His own | 355 Anthem on the Savior |
| We’ll anchor by and by. | 378t Heavenly Port |
| We’re bound by the cords of His love. | 376 Help Me to Sing |
| We lay our garments by | 209 Evening Shade |
| We walk by faith as strangers here | 500 Living Hope |
| What have I gained by sin, he said | 113 The Prodigal Son |
| When I shall lay my armor by | 285b Land of Rest 390 New Prospect |
| When man by transgressions was lost | 104 The Lovely Story |
| While shepherds watched their flocks by night | 186 Sherburne 461 Shining Star |
| Yet, oh! by faith I see | 77t The Child of Grace |