development.md (18655B)
1 ---
2 title: Contribute to Hugo Development
3 linktitle: Development
4 description: Hugo relies heavily on contributions from the open source community.
5 date: 2017-02-01
6 publishdate: 2017-02-01
7 lastmod: 2017-02-01
8 categories: [contribute]
9 keywords: [dev,open source]
10 authors: [digitalcraftsman]
11 menu:
12 docs:
13 parent: "contribute"
14 weight: 10
15 weight: 10
16 sections_weight: 10
17 draft: false
18 toc: true
19 ---
20
21 ## Introduction
22
23 Hugo is an open-source project and lives by the work of its [contributors][]. There are plenty of [open issues][issues], and we need your help to make Hugo even more awesome. You don't need to be a Go guru to contribute to the project's development.
24
25 ## Assumptions
26
27 This contribution guide takes a step-by-step approach in hopes of helping newcomers. Therefore, we only assume the following:
28
29 * You are new to Git or open-source projects in general
30 * You are a fan of Hugo and enthusiastic about contributing to the project
31
32 {{% note "Additional Questions?" %}}
33 If you're struggling at any point in this contribution guide, reach out to the Hugo community in [Hugo's Discussion forum](https://discourse.gohugo.io).
34 {{% /note %}}
35
36 ## Install Go
37
38 The installation of Go should take only a few minutes. You have more than one option to get Go up and running on your machine.
39
40 If you are having trouble following the installation guides for Go, check out [Go Bootcamp, which contains setups for every platform][gobootcamp] or reach out to the Hugo community in the [Hugo Discussion Forums][forums].
41
42 ### Install Go From Source
43
44 [Download the latest stable version of Go][godl] and follow the official [Go installation guide][goinstall].
45
46 Once you're finished installing Go, let's confirm everything is working correctly. Open a terminal---or command line under Windows--and type the following:
47
48 ```
49 go version
50 ```
51
52 You should see something similar to the following written to the console. Note that the version here reflects the most recent version of Go as of the last update for this page:
53
54 ```
55 go version go1.12 darwin/amd64
56 ```
57
58 Next, make sure that you set up your `GOPATH` [as described in the installation guide][setupgopath].
59
60 You can print the `GOPATH` with `echo $GOPATH`. You should see a non-empty string containing a valid path to your Go workspace; for example:
61
62 ```
63 /Users/<yourusername>/Code/go
64 ```
65
66 ### Install Go with Homebrew
67
68 If you are a MacOS user and have [Homebrew](https://brew.sh/) installed on your machine, installing Go is as simple as the following command:
69
70 {{< code file="install-go.sh" >}}
71 brew install go
72 {{< /code >}}
73
74 ### Install Go via GVM
75
76 More experienced users can use the [Go Version Manager][gvm] (GVM). GVM allows you to switch between different Go versions *on the same machine*. If you're a beginner, you probably don't need this feature. However, GVM makes it easy to upgrade to a new released Go version with just a few commands.
77
78 GVM comes in especially handy if you follow the development of Hugo over a longer period of time. Future versions of Hugo will usually be compiled with the latest version of Go. Sooner or later, you will have to upgrade if you want to keep up.
79
80 ## Create a GitHub Account
81
82 If you're going to contribute code, you'll need to have an account on GitHub. Go to [www.github.com/join](https://github.com/join) and set up a personal account.
83
84 ## Install Git on Your System
85
86 You will need to have Git installed on your computer to contribute to Hugo development. Teaching Git is outside the scope of the Hugo docs, but if you're looking for an excellent reference to learn the basics of Git, we recommend the [Git book][gitbook] if you are not sure where to begin. We will include short explanations of the Git commands in this document.
87
88 Git is a [version control system](https://en.wikipedia.org/wiki/Version_control) to track the changes of source code. Hugo depends on smaller third-party packages that are used to extend the functionality. We use them because we don't want to reinvent the wheel.
89
90 Go ships with a sub-command called `get` that will download these packages for us when we setup our working environment. The source code of the packages is tracked with Git. `get` will interact with the Git servers of the package hosters in order to fetch all dependencies.
91
92 Move back to the terminal and check if Git is already installed. Type in `git version` and press enter. You can skip the rest of this section if the command returned a version number. Otherwise [download](https://git-scm.com/downloads) the latest version of Git and follow this [installation guide](https://git-scm.com/book/en/v2/Getting-Started-Installing-Git).
93
94 Finally, check again with `git version` if Git was installed successfully.
95
96 ### Git Graphical Front Ends
97
98 There are several [GUI clients](https://git-scm.com/downloads/guis) that help you to operate Git. Not all are available for all operating systems and maybe differ in their usage. Because of this we will document how to use the command line, since the commands are the same everywhere.
99
100 ### Install Hub on Your System (Optional)
101
102 Hub is a great tool for working with GitHub. The main site for it is [hub.github.com](https://hub.github.com/). Feel free to install this little Git wrapper.
103
104 On a Mac, you can install [Hub](https://github.com/github/hub) using [Homebrew](https://brew.sh):
105
106 ```
107 brew install hub
108 ```
109
110 Now we'll create an [alias in Bash](https://tldp.org/LDP/abs/html/aliases.html) so that typing `git` actually runs `Hub`:
111
112 ```
113 echo "alias git='hub'" >> ~/.bash_profile
114 ```
115
116 Confirm the installation:
117
118 ```
119 git version 2.21.0
120 hub version 2.10.0
121 ```
122
123 ## Set up your working copy
124
125 You set up the working copy of the repository locally on your computer. Your local copy of the files is what you'll edit, compile, and end up pushing back to GitHub. The main steps are cloning the repository and creating your fork as a remote.
126
127 ### Clone the repository
128
129 We assume that you've set up your `GOPATH` (see the section above if you're unsure about this). You should now copy the Hugo repository down to your computer. You'll hear this called "clone the repo". GitHub's [help pages](https://help.github.com/articles/cloning-a-repository/) give us a short explanation:
130
131 > When you create a repository on GitHub, it exists as a remote repository. You can create a local clone of your repository on your computer and sync between the two locations.
132
133 We're going to clone the [master Hugo repository](https://github.com/gohugoio/hugo). That seems counter-intuitive, since you won't have commit rights on it. But it's required for the Go workflow. You'll work on a copy of the master and push your changes to your own repository on GitHub.
134
135 So, let's make a new directory and clone that master repository:
136
137 ```
138 mkdir $HOME/src
139 cd $HOME/src
140 git clone https://github.com/gohugoio/hugo.git
141 ```
142
143 > Since Hugo 0.48, Hugo uses the Go Modules support built into Go 1.11 to build.
144 > The easiest is to clone Hugo in a directory outside of GOPATH
145
146 And then, install dependencies of Hugo by running the following in the cloned directory:
147
148 ```
149 cd $HOME/src/hugo
150 go install
151 ```
152
153
154 Hugo relies on [mage](https://github.com/magefile/mage) for some convenient build and test targets. If you don't already have it, get it:
155
156 ```
157 go install github.com/magefile/mage@latest
158 ```
159
160 ### Fork the repository
161
162 If you're not familiar with this term, GitHub's [help pages](https://help.github.com/articles/fork-a-repo/) provide again a simple explanation:
163
164 > A fork is a copy of a repository. Forking a repository allows you to freely experiment with changes without affecting the original project.
165
166 #### Fork by hand
167
168 Open the [Hugo repository](https://github.com/gohugoio/hugo) on GitHub and click on the "Fork" button in the top right.
169
170 
171
172 Now open your fork repository on GitHub and copy the remote url of your fork. You can choose between HTTPS and SSH as protocol that Git should use for the following operations. HTTPS works always [if you're not sure](https://help.github.com/articles/which-remote-url-should-i-use/).
173
174 
175
176 Switch back to the terminal and move into the directory of the cloned master repository from the last step.
177
178 ```
179 cd $HOME/src/hugo
180 ```
181
182 Now Git needs to know that our fork exists by adding the copied remote url:
183
184 ```
185 git remote add <YOUR-GITHUB-USERNAME> <COPIED REMOTE-URL>
186 ```
187
188 #### Fork with Hub
189
190 Alternatively, you can use the Git wrapper Hub. Hub makes forking a repository easy:
191
192 ```
193 git fork
194 ```
195
196 That command will log in to GitHub using your account, create a fork of the repository that you're currently working in, and add it as a remote to your working copy.
197
198 #### Trust, but verify
199
200 Let's check if everything went right by listing all known remotes:
201
202 ```
203 git remote -v
204 ```
205
206 The output should look similar:
207
208 ```
209 digitalcraftsman git@github.com:digitalcraftsman/hugo.git (fetch)
210 digitalcraftsman git@github.com:digitalcraftsman/hugo.git (push)
211 origin https://github.com/gohugoio/hugo (fetch)
212 origin https://github.com/gohugoio/hugo (push)
213 ```
214
215 ## The Hugo Git Contribution Workflow
216
217 ### Create a new branch
218
219 You should never develop against the "master" branch. The development team will not accept a pull request against that branch. Instead, create a descriptive named branch and work on it.
220
221 First, you should always pull the latest changes from the master repository:
222
223 ```
224 git checkout master
225 git pull
226 ```
227
228 Now we can create a new branch for your additions:
229
230 ```
231 git checkout -b <BRANCH-NAME>
232 ```
233
234 You can check on which branch you are with `git branch`. You should see a list of all local branches. The current branch is indicated with a little asterisk.
235
236 ### Contribute to Documentation
237
238 Perhaps you want to start contributing to the Hugo docs. If so, you can ignore most of the following steps and focus on the `/docs` directory within your newly cloned repository. You can change directories into the Hugo docs using `cd docs`.
239
240 You can start Hugo's built-in server via `hugo server`. Browse the documentation by entering [http://localhost:1313](http://localhost:1313) in the address bar of your browser. The server automatically updates the page whenever you change content.
241
242 We have developed a [separate Hugo documentation contribution guide][docscontrib] for more information on how the Hugo docs are built, organized, and improved by the generosity of people like you.
243
244 ### Build Hugo
245
246 While making changes in the codebase it's a good idea to build the binary to test them:
247
248 ```
249 mage hugo
250 ```
251
252 This command generates the binary file at the root of the repository.
253
254 If you want to install the binary in `$GOPATH/bin`, run
255
256 ```
257 mage install
258 ```
259
260 ### Test
261 Sometimes changes on the codebase can cause unintended side effects. Or they don't work as expected. Most functions have their own test cases. You can find them in files ending with `_test.go`.
262
263 Make sure the commands
264
265 ```
266 mage -v check
267 ```
268
269 passes.
270
271 ### Formatting
272 The Go code styleguide maybe is opinionated but it ensures that the codebase looks the same, regardless who wrote the code. Go comes with its own formatting tool. Let's apply the styleguide to our additions:
273
274 ```
275 mage fmt
276 ```
277
278 Once you made your additions commit your changes. Make sure that you follow our [code contribution guidelines](https://github.com/gohugoio/hugo/blob/master/CONTRIBUTING.md):
279
280 ```
281 # Add all changed files
282 git add --all
283 git commit --message "YOUR COMMIT MESSAGE"
284 ```
285
286 The commit message should describe what the commit does (e.g. add feature XYZ), not how it is done.
287
288 ### Modify commits
289
290 You noticed some commit messages don't fulfill the code contribution guidelines or you just forget something to add some files? No problem. Git provides the necessary tools to fix such problems. The next two methods cover all common cases.
291
292 If you are unsure what a command does leave the commit as it is. We can fix your commits later in the pull request.
293
294 #### Modify the last commit
295
296 Let's say you want to modify the last commit message. Run the following command and replace the current message:
297
298 ```
299 git commit --amend -m"YOUR NEW COMMIT MESSAGE"
300 ```
301
302 Take a look at the commit log to see the change:
303
304 ```
305 git log
306 # Exit with q
307 ```
308
309 After making the last commit you may have forgot something. There is no need to create a new commit. Just add the latest changes and merge them into the intended commit:
310
311 ```
312 git add --all
313 git commit --amend
314 ```
315
316 #### Modify multiple commits
317
318 {{% warning "Be Careful Modifying Multiple Commits"%}}
319 Modifications such as those described in this section can have serious unintended consequences. Skip this section if you're not sure!
320 {{% /warning %}}
321
322 This is a bit more advanced. Git allows you to [rebase](https://git-scm.com/docs/git-rebase) commits interactively. In other words: it allows you to rewrite the commit history.
323
324 ```
325 git rebase --interactive @~6
326 ```
327
328 The `6` at the end of the command represents the number of commits that should be modified. An editor should open and present a list of last six commit messages:
329
330 ```
331 pick 80d02a1 tpl: Add hasPrefix to the template funcs' "smoke test"
332 pick aaee038 tpl: Sort the smoke tests
333 pick f0dbf2c tpl: Add the other test case for hasPrefix
334 pick 911c35b Add "How to contribute to Hugo" tutorial
335 pick 33c8973 Begin workflow
336 pick 3502f2e Refactoring and typo fixes
337 ```
338
339 In the case above we should merge the last two commits in the commit of this tutorial (`Add "How to contribute to Hugo" tutorial`). You can "squash" commits, i.e. merge two or more commits into a single one.
340
341 All operations are written before the commit message. Replace "pick" with an operation. In this case `squash` or `s` for short:
342
343 ```
344 pick 80d02a1 tpl: Add hasPrefix to the template funcs' "smoke test"
345 pick aaee038 tpl: Sort the smoke tests
346 pick f0dbf2c tpl: Add the other test case for hasPrefix
347 pick 911c35b Add "How to contribute to Hugo" tutorial
348 squash 33c8973 Begin workflow
349 squash 3502f2e Refactoring and typo fixes
350 ```
351
352 We also want to rewrite the commits message of the third last commit. We forgot "docs:" as prefix according to the code contribution guidelines. The operation to rewrite a commit is called `reword` (or `r` as shortcut).
353
354 You should end up with a similar setup:
355
356 ```
357 pick 80d02a1 tpl: Add hasPrefix to the template funcs' "smoke test"
358 pick aaee038 tpl: Sort the smoke tests
359 pick f0dbf2c tpl: Add the other test case for hasPrefix
360 reword 911c35b Add "How to contribute to Hugo" tutorial
361 squash 33c8973 Begin workflow
362 squash 3502f2e Refactoring and typo fixes
363 ```
364
365 Close the editor. It should open again with a new tab. A text is instructing you to define a new commit message for the last two commits that should be merged (aka "squashed"). Save the file with <kbd>CTRL</kbd>+<kbd>S</kbd> and close the editor again.
366
367 A last time a new tab opens. Enter a new commit message and save again. Your terminal should contain a status message. Hopefully this one:
368
369 ```
370 Successfully rebased and updated refs/heads/<BRANCHNAME>.
371 ```
372
373 Check the commit log if everything looks as expected. Should an error occur you can abort this rebase with `git rebase --abort`.
374
375 ### Push commits
376
377 To push our commits to the fork on GitHub we need to specify a destination. A destination is defined by the remote and a branch name. Earlier, the defined that the remote url of our fork is the same as our GitHub handle, in my case `digitalcraftsman`. The branch should have the same as our local one. This makes it easy to identify corresponding branches.
378
379 ```
380 git push --set-upstream <YOUR-GITHUB-USERNAME> <BRANCHNAME>
381 ```
382
383 Now Git knows the destination. Next time when you to push commits you just need to enter `git push`.
384
385 If you modified your commit history in the last step GitHub will reject your try to push. This is a safety-feature because the commit history isn't the same and new commits can't be appended as usual. You can enforce this push explicitly with `git push --force`.
386
387 ## Open a pull request
388
389 We made a lot of progress. Good work. In this step we finally open a pull request to submit our additions. Open the [Hugo master repository](https://github.com/gohugoio/hugo/) on GitHub in your browser.
390
391 You should find a green button labeled with "New pull request". But GitHub is clever and probably suggests you a pull request like in the beige box below:
392
393 
394
395 The new page summaries the most important information of your pull request. Scroll down and you find the additions of all your commits. Make sure everything looks as expected and click on "Create pull request".
396
397 ### Accept the contributor license agreement
398
399 Last but not least you should accept the contributor license agreement (CLA). A new comment should be added automatically to your pull request. Click on the yellow badge, accept the agreement and authenticate yourself with your GitHub account. It just takes a few clicks and only needs to be done once.
400
401 
402
403 ### Automatic builds
404
405 We use a GitHub Actions workflow to build and test. This is a matrix build across combinations of operating system (masOS, Windows, and Ubuntu) and Go versions. The workflow is triggered by the submission of a pull request. If you are a first-time contributor, the workflow requires approval from a project maintainer.
406
407 ## Where to start?
408
409 Thank you for reading through this contribution guide. Hopefully, we will see you again soon on GitHub. There are plenty of [open issues][issues] for you to help with.
410
411 Feel free to [open an issue][newissue] if you think you found a bug or you have a new idea to improve Hugo. We are happy to hear from you.
412
413 ## Additional References for Learning Git and Go
414
415 * [Codecademy's Free "Learn Git" Course][codecademy] (Free)
416 * [Code School and GitHub's "Try Git" Tutorial][trygit] (Free)
417 * [The Git Book][gitbook] (Free)
418 * [Go Bootcamp][gobootcamp]
419
420
421 [codecademy]: https://www.codecademy.com/learn/learn-git
422 [contributors]: https://github.com/gohugoio/hugo/graphs/contributors
423 [docscontrib]: /contribute/documentation/
424 [forums]: https://discourse.gohugo.io
425 [gitbook]: https://git-scm.com/
426 [gobootcamp]: https://www.golangbootcamp.com/book/get_setup
427 [godl]: https://golang.org/dl/
428 [goinstall]: https://golang.org/doc/install
429 [gvm]: https://github.com/moovweb/gvm
430 [issues]: https://github.com/gohugoio/hugo/issues
431 [newissue]: https://github.com/gohugoio/hugo/issues/new
432 [releases]: /getting-started/
433 [setupgopath]: https://golang.org/doc/code.html#Workspaces
434 [trygit]: https://try.github.io/levels/1/challenges/1