Create remote branches automatically

Posted on by
Have you ever created a branch on your computer and pushed it? Then you have probably been annoyed at the message: 
fatal: The current branch test-branch has no upstream branch.
To push the current branch and set the remote as upstream, use

    git push --set-upstream origin test-branch
But fear not! Help is near! Just add the following configuration option for git (the –global flag will put the option in your global git config, if you don’t want that, just remove the flag): 
git config --global push.autoSetupRemote true

Customize git comment char

Posted on by
If you want your git commit messages to contain “#” (for example because you want to reference ticket numbers), you have a problem: The character “#” is by default used for starting a comment. Luckily, you can easily change that with: 
git config core.commentChar ';'

LetsEncrypt Setup for domain hosted with HostEurope

Posted on by
As described earlier install certbot
HTTPS with LetsEncrypt and nginx Rename certbot fullchain.pem and privkey.pem to fullchain.txt and privkey.txt Upload using HostEurope KIS Webinterface
Produktverwaltung – Webhosting – Konfigurieren – Sicherheit & SSL – SSL administrieren
Wait 1-2 mins – voila, certificate renewed and validate Based on:
https://danielpietzsch.com/articles/he-ssl

Change a git commit from the past (not the most recent one)

Posted on by 
# Figure out which commit you want to edit by getting its SHA.
git log

# Start an interactive rebase ($SHA = your commit's SHA and the ^ is important!).
git rebase --interactive $SHA^

# [Change 'pick' to 'edit' for your commit and save the buffer]

# [Add your changes with git add -p, etc.]

# Change the commit and optionally add --no-edit if you want to keep the existing message.
git commit --amend

# Finalize and apply the rebase.
git rebase --continue

# Or cancel the rebase and go back to what it was like before you started rebasing.
git rebase --abort
From Nick Janetakis – Change a Git Commit in the Past with Amend and Rebase Interactive (https://nickjanetakis.com/blog/change-a-git-commit-in-the-past-with-amend-and-rebase-interactive)

Run Spark locally and access S3

Posted on by
By changing the code: 
val sparkConfig = new SparkConf()
   .set("fs.s3a.aws.credentials.provider", "com.amazonaws.auth.DefaultAWSCredentialsProviderChain")
   .setMaster("local[*]")
By adding JVM arguments to Java: 
-Dspark.master=local[*]
-Dspark.hadoop.fs.s3a.aws.credentials.provider=com.amazonaws.auth.DefaultAWSCredentialsProviderChain
By setting the JVM property from Java (I have not tested if this works for the credentials provider, but it should): 
System.setProperty("spark.master", "local[*]")
System.setProperty("spark.hadoop.fs.s3a.aws.credentials.provider", "com.amazonaws.auth.DefaultAWSCredentialsProviderChain")
The AWS credentials will be taken from the default profile or you can specify the profile with the environment variable AWS_PROFILE=<your profile.

Check connections to ports

Posted on by

To check what connections to ports are open on your computer:
ss -tlnp

Output:

State    Recv-Q   Send-Q     Local Address:Port      Peer Address:Port                                                                                        
LISTEN   0        128              0.0.0.0:22             0.0.0.0:*      users:(("sshd",pid=445,fd=3))                                                        
LISTEN   0        100              0.0.0.0:25             0.0.0.0:*      users:(("master",pid=929,fd=13))                                                     
LISTEN   0        128                    *:3306                 *:*      users:(("mysqld",pid=534,fd=30))                                                     
LISTEN   0        128                    *:80                   *:*      users:(("apache2",pid=765,fd=4),("apache2",pid=764,fd=4),("apache2",pid=515,fd=4))   
LISTEN   0        128                 [::]:22                [::]:*      users:(("sshd",pid=445,fd=4))                                                        
LISTEN   0        100                 [::]:25                [::]:*      users:(("master",pid=929,fd=14))                                                     
LISTEN   0        70                     *:33060                *:*      users:(("mysqld",pid=534,fd=33))